-- Logs begin at Wed 2022-08-10 10:25:18 UTC, end at Wed 2022-08-10 11:36:19 UTC. -- Aug 10 11:04:47.658809 dv-cinder-852724-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 11:04:47.666138 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 11:04:47 2022] *** Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: nodename: dv-cinder-852724-1-iscsi Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: machine: x86_64 Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: clock source: unix Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: pcre jit disabled Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: detected number of CPU cores: 4 Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: current working directory: / Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: detected binary path: /usr/bin/uwsgi-core Aug 10 11:04:47.669666 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: your processes number limit is 47680 Aug 10 11:04:47.671401 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: your memory page size is 4096 bytes Aug 10 11:04:47.671401 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: detected max file descriptor number: 2048 Aug 10 11:04:47.671401 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: lock engine: pthread robust mutexes Aug 10 11:04:47.671401 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: thunder lock: enabled Aug 10 11:04:47.671401 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 11:04:47.671401 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 11:04:47.709441 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: Python main interpreter initialized at 0x55a443f4d9c0 Aug 10 11:04:47.709441 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: python threads support enabled Aug 10 11:04:47.709441 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: your server socket listen backlog is limited to 100 connections Aug 10 11:04:47.709441 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: your mercy for graceful operations on workers is 90 seconds Aug 10 11:04:47.709801 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 11:04:47.709879 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: *** Operational MODE: preforking *** Aug 10 11:04:47.710098 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: *** uWSGI is running in multiple interpreter mode *** Aug 10 11:04:47.710098 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: spawned uWSGI master process (pid: 103460) Aug 10 11:04:47.710288 dv-cinder-852724-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 11:04:47.716105 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: spawned uWSGI worker 1 (pid: 103461, cores: 1) Aug 10 11:04:47.716105 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: spawned uWSGI worker 2 (pid: 103462, cores: 1) Aug 10 11:04:47.716105 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 11:04:48.364286 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:04:48.371227 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:04:49.441948 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:04:49.441948 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: from cryptography.utils import int_from_bytes Aug 10 11:04:49.442540 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:04:49.442540 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: from cryptography.utils import int_from_bytes Aug 10 11:04:49.445655 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:04:49.445655 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: from cryptography.utils import int_from_bytes Aug 10 11:04:49.446102 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:04:49.446102 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: from cryptography.utils import int_from_bytes Aug 10 11:04:51.908496 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:04:51.909047 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:04:51.910001 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:04:51.910100 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:04:51.910184 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:04:51.910271 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:04:51.910358 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:04:51.910440 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:04:51.910530 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:04:51.910652 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:04:51.910783 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.910956 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.911102 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.911277 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.911417 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.911593 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.911728 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.911909 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.912056 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.912234 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.912362 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.912540 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.912677 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.912853 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.912990 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.913161 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.913318 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.913475 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.913571 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.913729 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.913867 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.914036 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.914186 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852724-1-iscsi {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.914358 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852724-1-iscsi {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.914503 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.914711 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.914835 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.915016 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.915141 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.915324 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.915475 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.915621 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.915789 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.915920 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.916065 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.916221 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.916315 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.916522 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.916797 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.917020 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.917235 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.917359 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.917537 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.917661 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.917842 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.917969 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.918171 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.918376 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.918469 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.918895 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.919055 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.919197 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.919370 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.919458 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.919673 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.919768 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.919986 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.920071 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.920286 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.920386 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.920673 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852724-1-iscsi {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.920774 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852724-1-iscsi {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.920985 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.921073 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.921291 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.921375 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.921596 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.921680 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.922005 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.922113 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.922308 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.922401 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.922635 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.922771 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.922950 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.923036 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.923264 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.923349 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.923567 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.923654 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.923885 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.923969 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.924195 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.924290 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.924504 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.924590 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.924842 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.924934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.925137 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.925235 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.925436 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.925530 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.925736 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.925828 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.926044 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.926138 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.926339 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.926425 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.926657 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.926744 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.926903 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.926991 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.927202 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.927297 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.927517 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.927604 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.927830 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.927923 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.928142 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.928238 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.928390 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.928495 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.928635 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.928730 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.928945 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.929030 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.929255 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.929350 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.929555 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.929641 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.929857 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.929942 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.930157 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.930249 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.930457 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.930550 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.930786 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.930892 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.931082 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.931175 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.931379 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.931472 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.931679 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.931765 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.931998 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.932084 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.932306 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.932398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.932620 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.932707 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.932920 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.933013 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.933232 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.933324 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.933618 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.933703 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.933863 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.933949 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.934162 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.934246 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.934492 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.934613 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.934829 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.934917 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.935131 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.935217 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.935443 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.935546 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.935755 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.935841 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.936055 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.936149 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.936355 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.936457 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.936653 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.936740 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.936965 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.937064 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.937293 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.937389 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.937591 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.937677 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.937835 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.937922 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.938130 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.938216 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.938427 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.938513 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.938763 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.938852 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.939065 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.939165 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.939364 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.939450 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.939662 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.939755 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.939956 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.940056 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.940254 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.940340 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.940579 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.940665 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.940880 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.940967 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.941177 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.941263 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.941477 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.941571 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.941776 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.941862 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.942075 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.942163 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.942373 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.942470 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.942697 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.942800 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.943009 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.943095 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.943320 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.943415 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.943617 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.943743 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.943914 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.944000 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.944210 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.944306 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.944506 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.944606 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.944817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.944942 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.945115 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.945213 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.945409 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.945494 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.945721 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.945807 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.946016 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.946116 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.946312 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.946408 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.946644 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.946744 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.946948 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.947048 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.947247 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.947332 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.947557 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.947641 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.947849 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.947950 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.948148 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.948241 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.948456 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.948541 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.948751 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.948838 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.949048 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.949134 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.949343 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.949428 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.949636 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.949722 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.949930 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.950016 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.950225 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.950311 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.950520 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.950657 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.950844 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.950931 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.951140 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.951225 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.951450 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.951536 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.951760 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.951852 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.952060 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.952145 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.952356 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.952442 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.952653 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.952738 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.952963 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.953099 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:04:51.953292 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.953378 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.953617 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.953709 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.953953 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.954060 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.954262 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.954357 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.954604 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.954697 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.954935 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.955034 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.955250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.955336 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.955559 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.955644 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.955868 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.956448 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.956699 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.956792 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.957007 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.957092 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.957311 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.957397 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.957617 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.957710 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.957931 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.958017 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.958241 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.958353 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.958564 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.958666 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.958896 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.958983 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.959208 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.959335 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.959520 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.959614 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.959824 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.959911 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.960135 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.960223 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.960456 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.960549 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.960768 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.960862 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.961072 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.961168 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.961405 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.961494 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.961738 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.961834 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.962048 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.962136 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.962365 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.962456 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.962703 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.962812 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.963011 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.963106 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.963315 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.963405 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.963616 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.963712 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.963929 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.964015 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.964250 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.964337 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.964554 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.964650 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.964865 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.964961 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.965170 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.965256 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.965474 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.965565 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.965776 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.965861 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.966082 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.966176 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.966385 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.966472 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.966741 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.966849 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.967051 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.967138 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.967358 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.967453 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.967663 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.967749 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.967971 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.968064 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.968275 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.968363 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.968580 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.968675 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.968884 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.968970 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.969181 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.969275 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.969480 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.969565 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.969776 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.969871 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.970078 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.970165 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.970374 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.970463 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.970713 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.970822 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.971033 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.971120 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.971334 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.971420 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.972218 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.972327 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.972523 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.972611 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.972832 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.972932 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.973139 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.973236 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.973445 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.973536 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.973745 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.973832 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.974053 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.974142 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.974358 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.974445 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.974686 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.974777 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.975006 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.975094 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.975314 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.975407 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.975616 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.975710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.975934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.976028 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.976233 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.976328 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.976533 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.976659 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.976842 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.976930 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.977148 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.977234 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.977452 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.977547 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.977760 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.977846 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.978065 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.978150 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.978383 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.978483 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.978711 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.978801 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.979020 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.979109 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.979348 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.979443 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.979671 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.979757 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.979973 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.980058 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.980291 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.980381 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.980611 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.980696 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.980921 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.981016 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.981220 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.981307 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.981522 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.981645 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.981823 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.981910 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.982124 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.982211 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.982427 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.982514 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.982757 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.982864 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.983059 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.983159 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.983358 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.983490 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.983657 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.983744 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.983956 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.984044 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.984254 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.984343 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.984569 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.984664 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.984871 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.984970 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.985169 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.985256 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.985466 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.985562 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.985762 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.985848 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.986100 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.986230 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.986401 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.986498 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.986761 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.986861 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.987085 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.987194 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.987428 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.987517 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.987745 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.987831 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.988054 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.988141 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.988363 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.988451 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.988669 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.988755 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.988973 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.989069 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.989279 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.989367 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.989583 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.989668 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.989897 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.989984 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.990199 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.990286 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.990511 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.990616 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.990847 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.990945 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.991166 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.991255 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.991472 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.991557 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.991786 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.991879 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.992082 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.992169 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.992397 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.992485 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.992730 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.992824 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.993057 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.993145 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.993367 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.993453 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.993686 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.993784 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.993990 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.994085 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.994298 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.994384 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.994620 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.994725 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.994931 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.995029 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.995236 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.995323 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.995542 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.995638 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.995854 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.995941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.996160 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.996244 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.996477 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.996572 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.996776 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.996887 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.997089 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.997196 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.997393 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.997489 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.997706 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.997794 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.998006 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.998091 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.998314 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.998408 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.998653 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.998744 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.998985 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.999072 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.999288 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.999382 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.999591 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.999676 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:51.999904 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.000001 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.000211 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.000297 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.000512 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.000597 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.000815 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.000911 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.001114 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.001200 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.001413 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.001498 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.001715 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.001810 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.002023 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.002108 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.002331 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.002417 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.002658 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.002762 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.002985 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.003072 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.003294 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.003380 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.003604 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.003782 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.003958 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.004100 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.004238 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.004411 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.004626 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.004820 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.005031 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.005263 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.005470 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.005664 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.005951 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.006149 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.006321 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.006492 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.006635 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.006771 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.007086 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.007241 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.007380 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.007498 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.007627 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.007761 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.007861 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.007943 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.008022 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.008022 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.008164 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.008252 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.008426 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.008541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.008730 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.008993 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.009080 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.009325 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.009417 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.009638 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.009724 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.009943 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.010030 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.010253 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.010341 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.010558 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.010725 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.010882 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.010980 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.011188 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.011275 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.011493 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.011579 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.011797 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.011894 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.012102 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.012189 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.012412 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.012499 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.012717 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.012813 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.013019 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.013105 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.013326 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.013414 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.013626 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.013722 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.013933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.014031 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.014236 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.014322 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.014532 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.014640 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.014862 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.014948 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.015168 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.015254 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.015481 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.015736 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.016050 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.016138 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.016361 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.016447 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.016677 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.016756 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.017005 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.017091 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.017472 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.017583 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.017773 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.017876 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.018032 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.018121 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.018357 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.019050 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.019194 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.019295 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.019505 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.019604 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.019811 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.019900 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.020115 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.020202 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.020419 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.020508 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.020717 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.020813 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.021022 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.021109 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.021320 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.021408 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.021623 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.021718 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.021923 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.022086 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.022219 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.022321 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.022521 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.022629 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.022856 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.022958 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.023160 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.023250 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.023463 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.023549 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.023762 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.023896 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.024062 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.024150 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.024361 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.024456 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.024679 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.024786 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.024979 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.025069 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.025279 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.025373 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.025579 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.025681 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.025878 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.025965 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.026206 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.026293 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.026505 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.026664 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.026864 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.026983 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.027189 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.027289 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.027503 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.027637 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.027794 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.027884 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.028107 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.028203 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.028405 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.028492 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.028707 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.028794 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.029006 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.029105 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.029306 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.029394 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.029610 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.029705 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.029909 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.030007 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.030208 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.030296 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.030510 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.030634 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.030840 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.030977 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.031144 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.031240 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.031442 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.031532 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.031738 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.031838 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.032036 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.032123 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.032340 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.032427 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.032642 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.032730 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.032944 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.033031 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.033240 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.033327 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.033538 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.033633 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.033838 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.033925 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.034711 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.034815 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.035020 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.035109 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.035318 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.035412 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.035616 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.035703 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.035916 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.036014 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.036216 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.036306 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.036515 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.036612 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.036817 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.036914 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.037119 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.037206 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.037418 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.037515 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.037715 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.037801 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.038026 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.038114 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.038326 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.038423 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.038652 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.038742 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.038956 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.039043 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.039252 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.039352 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.039551 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.039639 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.039850 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.039940 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.040156 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.040245 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.040465 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.040559 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.040764 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.040853 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.041062 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.041150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.041359 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.041453 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.041657 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.041746 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.041954 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.042043 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.042256 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.042350 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.042551 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.042689 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.042880 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.042971 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.043177 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.043263 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.043474 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.043570 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.044036 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.044171 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.044334 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.044436 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.044645 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.044745 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.044945 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.045044 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.045244 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.045330 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.045541 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.045637 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.045839 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.045927 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.046168 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.046263 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.046468 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.046566 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.046837 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.046925 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.047149 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.047248 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.047460 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.047552 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.047763 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.047858 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.048069 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.048159 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.048374 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.048470 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.048670 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.048758 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.048972 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.049067 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.049273 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.049361 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.049579 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.049665 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.049907 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.050002 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.050206 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.050294 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.050506 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.050639 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.050837 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.050936 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.051143 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.051232 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.051449 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.051538 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.051764 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.051863 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.052080 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.052166 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.052377 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.052463 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.052680 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.052776 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.052982 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.053076 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.053284 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.053378 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.053585 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.053681 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.053886 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.053973 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.054189 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.054276 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.054493 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.054613 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.054822 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.054972 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.055125 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.055221 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.055429 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.055520 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.055730 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.055819 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.056029 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.056115 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.056330 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.056418 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.056630 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.056726 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.056927 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.057015 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.057238 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.057326 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.057537 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.057625 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.057833 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.057964 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.058130 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.058218 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.058426 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.058513 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.058745 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.058847 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.059043 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.059169 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.059463 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.059552 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.059768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.059869 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.060068 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.060164 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.060364 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.060452 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.060668 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.060768 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.060970 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.061056 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.061277 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.061363 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.061575 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.061676 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.061873 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.061982 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.062287 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.062375 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.062612 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.062704 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.062922 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.063008 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.063219 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.063308 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.063517 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.063606 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.063818 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.063916 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.064125 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.064221 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.064423 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.064511 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.064722 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.064809 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.065020 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.065107 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.065838 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.065940 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.066144 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.066231 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.066446 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.066546 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.066789 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.066879 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.067183 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.067271 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.067487 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.067586 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.067786 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.067898 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.068194 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.068292 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.068498 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.068600 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.068802 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.068889 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.069117 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.069203 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.069431 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.069530 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.069729 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.069824 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.070039 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.070140 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.070343 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.070431 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.070672 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.070778 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.070992 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.071087 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.071298 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.071396 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.071605 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.071693 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.071902 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.071997 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.072207 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.072304 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.072522 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.072619 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.072834 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.072924 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.073139 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.073226 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.073455 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.073544 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.073843 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.073930 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.074148 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.074235 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.074458 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.074558 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.074798 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.074888 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.075099 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.075201 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.075399 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.075495 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.075698 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.075798 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.075996 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.076092 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.076294 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.076389 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.076594 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.076683 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.076896 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.076992 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.077201 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.077296 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.077505 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.077609 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.077809 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.077909 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.078108 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.078195 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.078406 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.078501 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.078730 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.078822 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.079032 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.079119 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.079337 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.079436 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.079644 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.079740 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.079949 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.080082 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.080263 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.080358 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.080566 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.080656 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.080865 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.080990 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.081738 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.081835 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.082039 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.082137 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.082340 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.082428 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.082665 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.082845 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.082970 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.083071 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.083294 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.083381 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.083599 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.083697 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.083920 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.084009 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.084241 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.084328 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.084548 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.084650 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.084859 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.084954 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.085182 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.085277 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.085492 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.085590 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.085803 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.085891 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.086118 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.086212 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.086418 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.086508 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.086741 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.086831 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.087041 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.087129 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.087338 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.087496 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.087633 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.087768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.087905 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.088042 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.088186 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.088320 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.088493 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.088634 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.088778 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.088919 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.089066 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.089201 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.089345 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.089478 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.089661 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.089876 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.090014 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.090169 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.090261 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.090342 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.090549 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.090720 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.090871 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.090959 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.091169 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.091257 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.091470 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.091567 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.091789 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.091876 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.092094 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.092182 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.092402 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.092499 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.092718 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.092805 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.093030 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.093121 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.093340 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.093434 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.093648 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.093735 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.093956 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.094043 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.094263 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.094351 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.094583 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.094716 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.094900 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.095003 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.095211 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.095302 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.095518 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.095606 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.095827 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.095915 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.096134 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.096223 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.096447 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.096679 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.097003 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.097167 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.097313 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.097448 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.097631 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.097736 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.097943 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.098045 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.098251 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.098386 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.098562 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.098708 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.098896 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.098997 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.099201 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.099289 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.099506 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.099603 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.099809 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.099898 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.100115 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.100248 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.100436 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.100533 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.100750 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.100838 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.101071 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.101160 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.101381 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.101469 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.101692 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.101782 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.102001 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.102089 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.102311 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.102408 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.102647 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.102738 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.102988 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.103075 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.103289 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.103379 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.103591 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.103685 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.103899 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.103987 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.104210 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.104305 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.104513 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.104601 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.104818 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.104914 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.105122 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.105220 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.105426 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.105514 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.105732 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.105819 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.106037 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.106126 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.106341 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.106428 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.106669 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.106778 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.106980 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.107074 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.107298 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.107386 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.107611 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.107715 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.107920 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.108009 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.108228 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.108325 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.108536 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.108640 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.108849 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.109049 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.109361 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.109449 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.109672 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.109760 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.109996 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.110084 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.110316 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.110404 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.110648 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.110741 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.110962 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.111060 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.111276 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.111364 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.111572 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.111661 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.111873 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.111962 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.112248 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.112347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.112503 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.112600 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.112805 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.112892 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.113106 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.113208 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.113408 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.113496 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.113707 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.113795 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.114003 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.114099 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.114311 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.114400 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.114681 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.114873 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.115167 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.115268 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.115510 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.115606 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.115821 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.115957 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.116136 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.116233 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.116449 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.116538 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.116752 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.116841 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.117054 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.117155 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.117357 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.117444 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.117658 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.117755 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.117955 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.118045 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.118261 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.118349 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.118561 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.118684 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.118882 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.118972 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.119181 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.119267 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.119484 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.119586 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.119786 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.119874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.120087 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.120176 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.120385 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.120481 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.120681 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.120769 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.120997 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.121088 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.121296 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.121392 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.121593 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.121681 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.121890 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.121979 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.122189 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.122289 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.122488 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.122626 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.122811 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.122912 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.123112 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.123201 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.123408 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.123495 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.123707 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.123817 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.124005 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.124094 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.124299 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.124396 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.124598 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.124695 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.124897 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.125004 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.125192 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.125294 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.125489 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.125578 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.125786 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.125883 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.126092 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.126187 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.126391 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.126486 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.126761 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.126853 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.127069 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.127160 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.127373 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.127471 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.127683 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.128292 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.128509 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.128627 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.128815 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.128919 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.129148 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.129235 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.129460 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.129679 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.129989 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.130092 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.130316 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.130408 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.130652 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.130765 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.131001 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.131089 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.131296 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.131391 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.131601 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.131690 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.131903 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.131998 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.132206 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.132294 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.132516 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.132609 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.132824 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.132912 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.133127 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.133213 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.133434 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.133522 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.133737 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.133825 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.134041 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.134127 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.134347 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.134443 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.134672 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.134761 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.134983 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.135094 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.135282 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.135386 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.135584 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.135679 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.135884 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.135972 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.136187 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.136284 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.136488 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.136576 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.136789 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.136876 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.137099 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.137201 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.137420 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.137508 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.137737 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.137850 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.138046 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.138149 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.138360 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.138474 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.138722 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.138822 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.139002 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.139098 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.139304 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.139391 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.139604 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.139690 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.139910 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.139999 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.140220 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.140307 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.140526 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.140638 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.140831 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.140930 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.141131 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.141225 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.141529 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.141634 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.141834 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.141920 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.142145 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.142232 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.142454 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.142543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.142789 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.142877 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.143104 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.143204 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.143459 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.144074 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.144281 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.144370 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.144589 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.144676 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.144916 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.145013 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.145237 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.145339 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.145559 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.145656 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.145878 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.145966 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.146181 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.146277 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.146481 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.146602 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.146802 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.146902 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.147106 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.147193 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.147410 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.147507 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.147714 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.147800 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.148017 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.148113 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.148310 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.148410 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.148608 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.148741 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.148914 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.149046 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.149211 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.149347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.149511 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.149648 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.149811 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.149949 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.150110 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.150252 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.150414 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.150552 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.150736 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.150871 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.151037 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.151171 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.151335 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.151469 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.151632 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.151768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.151930 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.152065 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.152227 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.152369 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.152529 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.152666 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.152831 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.152965 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.153130 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.153268 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.153427 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.153565 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.153726 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.153861 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.154022 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.154186 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.154346 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.154513 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.154695 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.154846 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.155003 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.155163 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.155327 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.155526 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.155627 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.155773 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.155935 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.156080 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.156236 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.156394 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.156551 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.156710 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.156865 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.157019 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.157176 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.157324 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.157483 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.157650 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.157811 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.157958 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.158120 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.158265 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.158428 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.158601 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.158762 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.158894 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.159091 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.159226 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.159398 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.159531 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.159704 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.159850 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.160025 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.160171 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.160346 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.160472 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.160647 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.160791 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.160966 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.161105 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.161278 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.161404 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.161593 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.161714 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.161904 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.162020 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.162210 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.162344 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.162533 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.162675 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.162870 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.162982 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.163178 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.163294 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.163484 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.163600 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.163790 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.163892 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.164096 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.164203 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.164406 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.164496 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.164712 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.164799 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.165018 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.165118 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.165329 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.165431 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.165641 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.165740 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.165964 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.166085 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.166286 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.166393 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.166608 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.166718 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.166931 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.167031 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.167254 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.167344 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.167561 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.167649 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.167889 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.167978 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.168211 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.168312 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.168519 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.168910 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.169095 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.169251 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.169395 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.169535 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.169678 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:04:52.169815 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:04:52.169960 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:04:52.323122 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Registered counter for database nova_api Aug 10 11:04:52.323328 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO dbcounter [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Registered counter for database nova_api Aug 10 11:04:52.343145 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_db.sqlalchemy.engines [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:04:52.346380 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:04:52.350278 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writer thread running {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:04:52.353415 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:04:52.405436 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.context [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9412f8ab-5880-4cdf-b6de-459533ed5749(cell1) {{(pid=103461) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:04:52.408472 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.context [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9412f8ab-5880-4cdf-b6de-459533ed5749(cell1) {{(pid=103462) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:04:52.409780 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:04:52.410257 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:04:52.411847 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:04:52.412572 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:04:52.412923 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:04:52.413013 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:04:52.413398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:04:52.415007 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:04:52.415107 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:04:52.415731 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:04:52.416178 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:04:52.416963 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO dbcounter [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Registered counter for database nova_cell0 Aug 10 11:04:52.418165 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:04:52.420469 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Registered counter for database nova_cell0 Aug 10 11:04:52.422534 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO dbcounter [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Registered counter for database nova_cell1 Aug 10 11:04:52.425823 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Registered counter for database nova_cell1 Aug 10 11:04:52.429474 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_db.sqlalchemy.engines [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:04:52.431941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_db.sqlalchemy.engines [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:04:52.433133 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:04:52.436831 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writer thread running {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:04:52.437609 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:04:52.438248 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:04:52.571062 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writer thread running {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:04:52.577069 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:04:52.580848 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO dbcounter [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Registered counter for database nova_cell0 Aug 10 11:04:52.586180 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Registered counter for database nova_cell0 Aug 10 11:04:52.590311 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_db.sqlalchemy.engines [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:04:52.593070 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:04:52.594724 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writer thread running {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:04:52.598065 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:04:52.933069 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: WARNING keystonemiddleware.auth_token [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:04:52.940881 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: WARNING keystonemiddleware.auth_token [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:04:52.948774 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:04:52.956655 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:04:53.281256 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: WARNING keystonemiddleware.auth_token [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:04:53.287445 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: WARNING keystonemiddleware.auth_token [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:04:53.292687 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a443f4d9c0 pid: 103461 (default app) Aug 10 11:04:53.295074 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:04:53.296223 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 Aug 10 11:04:53.296637 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Wed Aug 10 11:04:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:04:53.310102 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:04:53.316659 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-89f03c8c-bb36-4d77-b61a-f858106a1ddb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:04:53.321909 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a443f4d9c0 pid: 103462 (default app) Aug 10 11:06:08.434164 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:08.435230 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 10 11:06:08.436865 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:08.456263 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=3 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:08.458010 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_cell0:SELECT=3 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:08.459040 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_cell1:SELECT=3 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:08.460079 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:09.326115 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-d7cda04f-f0dc-4cbe-ad87-950bf97c0e10 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:09.357970 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-d7cda04f-f0dc-4cbe-ad87-950bf97c0e10 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.914818 Aug 10 11:06:09.358740 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 10 11:06:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:06:11.544426 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:11.545636 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-20a928d5-3596-44e0-9af8-6998d1ada39c None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 10 11:06:11.545902 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:12.007737 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-85eb2e31-640b-4d41-8c62-4f64b480a8e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "ram": 256}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:12.028314 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:12.028314 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: warnings.warn(msg) Aug 10 11:06:12.056981 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-85eb2e31-640b-4d41-8c62-4f64b480a8e7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.503380 Aug 10 11:06:12.058162 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:12.071594 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=3 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:12.072553 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell0:SELECT=3 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:12.073642 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell1:SELECT=3 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:12.074564 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:12.289567 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-5bed4afa-8e68-4dc7-872b-737508a2e44e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:12.294171 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:12.294171 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Aug 10 11:06:12.365267 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-5bed4afa-8e68-4dc7-872b-737508a2e44e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298999 Aug 10 11:06:12.370160 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 11:06:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:06:14.611498 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-85eb2e31-640b-4d41-8c62-4f64b480a8e7 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:14.612761 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-85eb2e31-640b-4d41-8c62-4f64b480a8e7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Aug 10 11:06:14.613445 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:15.261005 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-eb3a6218-c66b-4299-9a22-7183fbf78471 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:15.283152 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:15.283152 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Aug 10 11:06:15.303719 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-eb3a6218-c66b-4299-9a22-7183fbf78471 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.683882 Aug 10 11:06:15.304906 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:15.317097 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-a0d134b4-4813-4ae9-9edf-d88f0303d6e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:15.320041 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:06:15.320041 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: warnings.warn(msg) Aug 10 11:06:15.353339 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-a0d134b4-4813-4ae9-9edf-d88f0303d6e8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040431 Aug 10 11:06:15.358720 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 11:06:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:06:17.703006 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-eb3a6218-c66b-4299-9a22-7183fbf78471 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:17.704138 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-eb3a6218-c66b-4299-9a22-7183fbf78471 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 10 11:06:17.710617 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:18.133600 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-301aafcb-9dd4-46c9-b6ca-a3d42efa6bae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "swap": 0, "id": "d2", "disk": 10}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:18.155870 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-301aafcb-9dd4-46c9-b6ca-a3d42efa6bae admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445345 Aug 10 11:06:18.156558 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:06:18.169391 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-e585c898-e07f-4014-9b3e-aa8b3bbea5e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:18.194270 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-e585c898-e07f-4014-9b3e-aa8b3bbea5e4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028687 Aug 10 11:06:18.207033 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 11:06:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:06:20.432939 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-301aafcb-9dd4-46c9-b6ca-a3d42efa6bae admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:20.433935 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-301aafcb-9dd4-46c9-b6ca-a3d42efa6bae admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 10 11:06:20.434499 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:20.859528 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-546bb97b-e6c5-40d9-aab5-8e85eb628d3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "disk": 10, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:20.887705 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-546bb97b-e6c5-40d9-aab5-8e85eb628d3b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447052 Aug 10 11:06:20.890057 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:20.903372 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-78df9718-2dd2-4b48-a2c0-7228dd5d5509 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:20.955117 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-78df9718-2dd2-4b48-a2c0-7228dd5d5509 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055433 Aug 10 11:06:20.956045 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 11:06:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:06:23.177866 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-546bb97b-e6c5-40d9-aab5-8e85eb628d3b admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:23.178912 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-546bb97b-e6c5-40d9-aab5-8e85eb628d3b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 10 11:06:23.179321 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:23.596610 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-ff76308b-4542-4df4-bbcd-de729c9dd4a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "swap": 0, "vcpus": 4}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:23.626098 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-ff76308b-4542-4df4-bbcd-de729c9dd4a2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440100 Aug 10 11:06:23.627216 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:06:23.640028 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-4c7dc674-47cc-47c7-a58a-b94f09b36c0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:23.664998 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-4c7dc674-47cc-47c7-a58a-b94f09b36c0a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028806 Aug 10 11:06:23.665569 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 11:06:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:06:26.019940 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-ff76308b-4542-4df4-bbcd-de729c9dd4a2 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:26.020953 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-ff76308b-4542-4df4-bbcd-de729c9dd4a2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 10 11:06:26.021348 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:26.447271 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-d44183eb-6ba7-4f67-b2e9-ff63f6a7681b admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:26.470532 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-d44183eb-6ba7-4f67-b2e9-ff63f6a7681b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.443013 Aug 10 11:06:26.471097 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 10 11:06:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:06:28.663531 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-ff76308b-4542-4df4-bbcd-de729c9dd4a2 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:28.664969 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-ff76308b-4542-4df4-bbcd-de729c9dd4a2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Aug 10 11:06:28.665456 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:29.103668 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-c59272cc-59b2-4ee0-9597-df22819eebfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "disk": 1, "swap": 0}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:29.126158 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-c59272cc-59b2-4ee0-9597-df22819eebfd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.453999 Aug 10 11:06:29.126815 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:29.141883 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-530a62c1-d692-4527-8ad1-700b7016728b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:29.171944 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-530a62c1-d692-4527-8ad1-700b7016728b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035341 Aug 10 11:06:29.172662 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 11:06:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:06:31.493089 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-c59272cc-59b2-4ee0-9597-df22819eebfd admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:31.494107 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-c59272cc-59b2-4ee0-9597-df22819eebfd admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Aug 10 11:06:31.494678 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:06:31.891790 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-955833a5-1d60-4ce6-a4ee-a01c8c3ca2df admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:31.911317 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-955833a5-1d60-4ce6-a4ee-a01c8c3ca2df admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.410841 Aug 10 11:06:31.911792 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:06:31.924167 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-d3b27208-0a1d-4bbf-9fcb-b8c695f02270 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:31.947038 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-d3b27208-0a1d-4bbf-9fcb-b8c695f02270 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026529 Aug 10 11:06:31.947595 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 11:06:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:06:34.120350 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-955833a5-1d60-4ce6-a4ee-a01c8c3ca2df admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:34.121354 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-955833a5-1d60-4ce6-a4ee-a01c8c3ca2df admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 10 11:06:34.121756 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:34.534860 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-a8c49c94-3dc4-4636-8ac5-fa5360d67444 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "vcpus": 2, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:34.555420 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-a8c49c94-3dc4-4636-8ac5-fa5360d67444 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.426946 Aug 10 11:06:34.556871 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:06:34.569817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-b46de813-e5c6-48dd-be24-f7593afb28f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:34.600966 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-b46de813-e5c6-48dd-be24-f7593afb28f8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034825 Aug 10 11:06:34.601556 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 11:06:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:06:36.813327 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-a8c49c94-3dc4-4636-8ac5-fa5360d67444 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:36.814343 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-a8c49c94-3dc4-4636-8ac5-fa5360d67444 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Aug 10 11:06:36.814780 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:37.296512 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-4e1e98d8-b13b-48b3-a2f1-71e8a444c39c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "swap": 0, "id": "4"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:37.316614 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-4e1e98d8-b13b-48b3-a2f1-71e8a444c39c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.495986 Aug 10 11:06:37.317392 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:06:37.329450 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-f468321d-79c2-4de1-9b3e-5c5d5983ebc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:37.355103 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-f468321d-79c2-4de1-9b3e-5c5d5983ebc4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029111 Aug 10 11:06:37.356064 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 11:06:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:06:39.727692 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-4e1e98d8-b13b-48b3-a2f1-71e8a444c39c admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:06:39.729022 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-4e1e98d8-b13b-48b3-a2f1-71e8a444c39c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001863 Aug 10 11:06:39.734642 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:06:40.156030 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-4e9cc4ad-5dc0-465e-86f3-3087336e61a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:40.185619 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-4e9cc4ad-5dc0-465e-86f3-3087336e61a6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449438 Aug 10 11:06:40.186258 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 11:06:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:40.199629 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-471b2bc9-c6af-4d2a-9640-4330936d1502 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:06:40.205497 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:40.230549 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-471b2bc9-c6af-4d2a-9640-4330936d1502 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034980 Aug 10 11:06:40.234609 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 11:06:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:07:00.572750 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-4e9cc4ad-5dc0-465e-86f3-3087336e61a6 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:00.573744 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-4e9cc4ad-5dc0-465e-86f3-3087336e61a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 10 11:07:00.574133 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:07:00.958090 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-74d0b063-012a-4bf2-9e68-ee258bc16cd0 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:00.975796 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-74d0b063-012a-4bf2-9e68-ee258bc16cd0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395826 Aug 10 11:07:00.976333 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 10 11:07:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:07:02.025361 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-4e9cc4ad-5dc0-465e-86f3-3087336e61a6 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:02.026394 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-4e9cc4ad-5dc0-465e-86f3-3087336e61a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 10 11:07:02.026838 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:07:02.544407 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-ae6571be-6519-4f4e-903c-389973c4b05b admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:02.550840 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.wsgi [None req-ae6571be-6519-4f4e-903c-389973c4b05b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-ae6571be-6519-4f4e-903c-389973c4b05b admin admin] Request method failure captured: Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Accept: application/json Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Accept-Encoding: gzip, deflate Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Connection: keep-alive Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Content-Length: 0 Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Host: 10.222.0.49 Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Openstack-Api-Version: compute 2.90 Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Openstack-System-Scope: None Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: User-Agent: python-novaclient Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Auth-Token: gAAAAABi85FVEF7adYU_c2WLnyAPIdhABvxiDc_kklCbKMVxFzl61AWWLFXuiVBY9bRAfxaP3AeMhSwoMGYxAJBZ0DNprvFTqlUiGDOv4qC47vyEtS57uzt9ZGP44de6hCtpTvmNfvo1GEs3I-RgVkOgpZfXBnRm2xoGl_pd2vq-QDITouJOTF0 Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Domain-Id: None Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Domain-Name: None Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Identity-Status: Confirmed Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Is-Admin-Project: True Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Id: default Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Name: Default Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Name: admin Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Role: admin,member,reader Aug 10 11:07:02.554212 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Roles: admin,member,reader Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Tenant: admin Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Tenant-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Tenant-Name: admin Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User: admin Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Id: default Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Name: Default Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Id: 8727d28e1a63419baaa4c9f20a7bc777 Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Name: admin Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: method: > Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: exception: Flavor 42 could not be found. Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: action_args: {'id': '42'} Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:07:02.555803 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:02.556915 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.558430 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-ae6571be-6519-4f4e-903c-389973c4b05b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:07:02.559700 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-ae6571be-6519-4f4e-903c-389973c4b05b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391258 Aug 10 11:07:02.559700 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 10 11:07:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:07:02.565317 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-9b740f17-b2bc-4da3-8771-fd3fba834393 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:02.569510 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:02.590131 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-9b740f17-b2bc-4da3-8771-fd3fba834393 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028373 Aug 10 11:07:02.590698 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 11:07:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:07:02.601242 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-97ee658a-1856-4d2e-8bc4-1a1a0b5822f0 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:02.625161 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-97ee658a-1856-4d2e-8bc4-1a1a0b5822f0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027440 Aug 10 11:07:02.625711 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 11:07:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:07:02.635717 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-7e137958-0f72-4983-8532-18773e5b78bc admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:02.642069 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.wsgi [None req-7e137958-0f72-4983-8532-18773e5b78bc admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-7e137958-0f72-4983-8532-18773e5b78bc admin admin] Request method failure captured: Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Accept: application/json Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Accept-Encoding: gzip, deflate Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Connection: keep-alive Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Content-Length: 0 Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Host: 10.222.0.49 Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Openstack-Api-Version: compute 2.90 Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Openstack-System-Scope: None Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: User-Agent: python-novaclient Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Auth-Token: gAAAAABi85FVEF7adYU_c2WLnyAPIdhABvxiDc_kklCbKMVxFzl61AWWLFXuiVBY9bRAfxaP3AeMhSwoMGYxAJBZ0DNprvFTqlUiGDOv4qC47vyEtS57uzt9ZGP44de6hCtpTvmNfvo1GEs3I-RgVkOgpZfXBnRm2xoGl_pd2vq-QDITouJOTF0 Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Domain-Id: None Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Domain-Name: None Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Identity-Status: Confirmed Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Is-Admin-Project: True Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Id: default Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Name: Default Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Name: admin Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Role: admin,member,reader Aug 10 11:07:02.645375 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Roles: admin,member,reader Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Tenant: admin Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Tenant-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Tenant-Name: admin Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User: admin Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Id: default Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Name: Default Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Id: 8727d28e1a63419baaa4c9f20a7bc777 Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Name: admin Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: method: > Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: exception: Flavor 42 could not be found. Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: action_args: {'id': '42'} Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:07:02.646941 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:02.648807 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:02.649934 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-7e137958-0f72-4983-8532-18773e5b78bc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:07:02.650970 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-7e137958-0f72-4983-8532-18773e5b78bc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015344 Aug 10 11:07:02.650970 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 10 11:07:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 11:07:03.621086 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-97ee658a-1856-4d2e-8bc4-1a1a0b5822f0 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:03.622116 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-97ee658a-1856-4d2e-8bc4-1a1a0b5822f0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 10 11:07:03.622506 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:07:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:07:04.137242 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-22dc851c-6161-4649-828f-7617c0f226de admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:04.143061 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.wsgi [None req-22dc851c-6161-4649-828f-7617c0f226de admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-22dc851c-6161-4649-828f-7617c0f226de admin admin] Request method failure captured: Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Accept: application/json Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Accept-Encoding: gzip, deflate Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Connection: keep-alive Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Content-Length: 0 Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Host: 10.222.0.49 Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Openstack-Api-Version: compute 2.90 Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Openstack-System-Scope: None Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: User-Agent: python-novaclient Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Auth-Token: gAAAAABi85FX-vOoUTcRQ2DMSG5yLExSmSKE9dniqLtDtJw4_RIDfYSjBQus7cBNx-7_CbkSYCyb0DbxCH69hSs7rmr8b4mi4BC3uI1u3NB8EsBWbtp_e03yrmrxQICpMDO0dD2MynWsg3D69b2TwdvgsEOQ5YqwVer3BZgwWynRSqOyNIf7gQg Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Domain-Id: None Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Domain-Name: None Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Identity-Status: Confirmed Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Is-Admin-Project: True Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Id: default Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Name: Default Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Name: admin Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Role: admin,member,reader Aug 10 11:07:04.144541 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Roles: admin,member,reader Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Tenant: admin Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Tenant-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Tenant-Name: admin Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User: admin Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Id: default Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Name: Default Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Id: 8727d28e1a63419baaa4c9f20a7bc777 Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Name: admin Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: method: > Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: exception: Flavor 84 could not be found. Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: action_args: {'id': '84'} Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:07:04.145908 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:04.146775 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.147882 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-22dc851c-6161-4649-828f-7617c0f226de admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:07:04.149022 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-22dc851c-6161-4649-828f-7617c0f226de admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.384630 Aug 10 11:07:04.149022 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 10 11:07:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:07:04.155429 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-8527d5ac-c208-42b3-a623-988b5ef36932 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:04.171087 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-8527d5ac-c208-42b3-a623-988b5ef36932 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019171 Aug 10 11:07:04.172232 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 11:07:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:07:04.181489 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-b03655df-a913-4249-b52e-2e7643fadcba admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:04.196060 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-b03655df-a913-4249-b52e-2e7643fadcba admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018202 Aug 10 11:07:04.196563 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 11:07:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:07:04.205623 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-b61d3f80-97cd-4d84-8e0d-28c4188b1497 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:04.210855 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.wsgi [None req-b61d3f80-97cd-4d84-8e0d-28c4188b1497 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-b61d3f80-97cd-4d84-8e0d-28c4188b1497 admin admin] Request method failure captured: Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Accept: application/json Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Accept-Encoding: gzip, deflate Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Connection: keep-alive Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Content-Length: 0 Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Host: 10.222.0.49 Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Openstack-Api-Version: compute 2.90 Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Openstack-System-Scope: None Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: User-Agent: python-novaclient Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Auth-Token: gAAAAABi85FX-vOoUTcRQ2DMSG5yLExSmSKE9dniqLtDtJw4_RIDfYSjBQus7cBNx-7_CbkSYCyb0DbxCH69hSs7rmr8b4mi4BC3uI1u3NB8EsBWbtp_e03yrmrxQICpMDO0dD2MynWsg3D69b2TwdvgsEOQ5YqwVer3BZgwWynRSqOyNIf7gQg Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Domain-Id: None Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Domain-Name: None Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Identity-Status: Confirmed Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Is-Admin-Project: True Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Id: default Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Name: Default Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Name: admin Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Role: admin,member,reader Aug 10 11:07:04.212347 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Roles: admin,member,reader Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Tenant: admin Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Tenant-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Tenant-Name: admin Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User: admin Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Id: default Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Name: Default Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Id: 8727d28e1a63419baaa4c9f20a7bc777 Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Name: admin Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: method: > Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: exception: Flavor 84 could not be found. Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: action_args: {'id': '84'} Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:07:04.213874 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:04.214768 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:04.215817 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-b61d3f80-97cd-4d84-8e0d-28c4188b1497 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:07:04.216997 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-b61d3f80-97cd-4d84-8e0d-28c4188b1497 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011515 Aug 10 11:07:04.216997 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 10 11:07:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:07:05.173057 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-b03655df-a913-4249-b52e-2e7643fadcba admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:05.174060 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-b03655df-a913-4249-b52e-2e7643fadcba admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 10 11:07:05.174450 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:07:05.683476 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-896aa109-bd85-4029-9b79-250c374d35e6 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:05.689631 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.wsgi [None req-896aa109-bd85-4029-9b79-250c374d35e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-896aa109-bd85-4029-9b79-250c374d35e6 admin admin] Request method failure captured: Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Accept: application/json Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Accept-Encoding: gzip, deflate Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Connection: keep-alive Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Content-Length: 0 Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Host: 10.222.0.49 Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Openstack-Api-Version: compute 2.90 Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Openstack-System-Scope: None Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: User-Agent: python-novaclient Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Auth-Token: gAAAAABi85FZU0MVCybOkLunMfu6OkNNKtV38EZl2g5VQmuqzo3Kc5d_9cS_rOmcNIfVFMBEga0d3kSPhoKDQWCJsYOtwRGMCbBJsG9RJSznc9JIXQcVhv09LI-qFb97mA1B-RRt4Q9MaT1h_poaqsdIb6iu8TLxhve2xtKmTkmITxTpDbquL24 Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Domain-Id: None Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Domain-Name: None Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Identity-Status: Confirmed Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Is-Admin-Project: True Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Id: default Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Name: Default Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Project-Name: admin Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Role: admin,member,reader Aug 10 11:07:05.691150 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Roles: admin,member,reader Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Tenant: admin Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Tenant-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-Tenant-Name: admin Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User: admin Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Id: default Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Name: Default Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Id: 8727d28e1a63419baaa4c9f20a7bc777 Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: X-User-Name: admin Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: method: > Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: exception: Flavor 451 could not be found. Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: action_args: {'id': '451'} Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:07:05.692816 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:05.693933 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.695398 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-896aa109-bd85-4029-9b79-250c374d35e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:07:05.696638 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-896aa109-bd85-4029-9b79-250c374d35e6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.380208 Aug 10 11:07:05.696638 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 11:07:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 11:07:05.702023 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-8bde2e01-2cdf-498b-8ef1-c9ff34614585 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:05.717082 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-8bde2e01-2cdf-498b-8ef1-c9ff34614585 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018554 Aug 10 11:07:05.717595 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 11:07:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:07:05.726747 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:05.741385 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018117 Aug 10 11:07:05.741899 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 11:07:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:07:05.751124 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-22183d26-7c3f-4929-b710-bc7fd6ba51f9 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:05.756241 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.wsgi [None req-22183d26-7c3f-4929-b710-bc7fd6ba51f9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-22183d26-7c3f-4929-b710-bc7fd6ba51f9 admin admin] Request method failure captured: Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Accept: application/json Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Accept-Encoding: gzip, deflate Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Connection: keep-alive Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Content-Length: 0 Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Host: 10.222.0.49 Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Openstack-Api-Version: compute 2.90 Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Openstack-System-Scope: None Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: User-Agent: python-novaclient Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Auth-Token: gAAAAABi85FZU0MVCybOkLunMfu6OkNNKtV38EZl2g5VQmuqzo3Kc5d_9cS_rOmcNIfVFMBEga0d3kSPhoKDQWCJsYOtwRGMCbBJsG9RJSznc9JIXQcVhv09LI-qFb97mA1B-RRt4Q9MaT1h_poaqsdIb6iu8TLxhve2xtKmTkmITxTpDbquL24 Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Domain-Id: None Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Domain-Name: None Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Identity-Status: Confirmed Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Is-Admin-Project: True Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Id: default Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Name: Default Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Project-Name: admin Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Role: admin,member,reader Aug 10 11:07:05.757710 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Roles: admin,member,reader Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd03b7da5c5c4a22928c3c3d2bce3325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Tenant: admin Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Tenant-Id: dd03b7da5c5c4a22928c3c3d2bce3325 Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-Tenant-Name: admin Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User: admin Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Id: default Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Name: Default Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Id: 8727d28e1a63419baaa4c9f20a7bc777 Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: X-User-Name: admin Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: method: > Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: exception: Flavor 451 could not be found. Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: action_args: {'id': '451'} Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:07:05.759272 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:05.760250 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Aug 10 11:07:05.761543 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-22183d26-7c3f-4929-b710-bc7fd6ba51f9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:07:05.762797 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-22183d26-7c3f-4929-b710-bc7fd6ba51f9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011856 Aug 10 11:07:05.762797 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 11:07:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:07:06.709590 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:06.710623 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 10 11:07:06.711016 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:07:07.222720 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-16df4b09-6655-4f8f-a586-f5747815bed1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:07:07.241350 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-16df4b09-6655-4f8f-a586-f5747815bed1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.391639 Aug 10 11:07:07.241877 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 10 11:07:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:07:08.215456 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:08.216451 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 10 11:07:08.216839 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:07:08.753715 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-6610cbb3-fb86-4169-8130-5969e38c1671 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:07:08.771123 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-6610cbb3-fb86-4169-8130-5969e38c1671 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.418855 Aug 10 11:07:08.771588 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 10 11:07:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:07:09.738906 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:09.739911 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 10 11:07:09.740302 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:07:10.265157 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-030dfdd4-f725-452b-949a-2b022cad85a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:07:10.284055 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-030dfdd4-f725-452b-949a-2b022cad85a2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.403692 Aug 10 11:07:10.284583 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 10 11:07:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:07:11.275746 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:11.276747 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 10 11:07:11.277141 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:07:11.795246 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-b098d3cd-bcce-477c-9baf-81cef1f3c940 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:07:11.814203 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-b098d3cd-bcce-477c-9baf-81cef1f3c940 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.397752 Aug 10 11:07:11.814791 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 10 11:07:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:07:12.774326 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:12.775387 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 10 11:07:12.775783 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:07:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:07:13.281813 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-4d9b46f7-011e-4d78-83ac-f1177362bba9 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:07:13.303292 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-4d9b46f7-011e-4d78-83ac-f1177362bba9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.392903 Aug 10 11:07:13.303828 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Aug 10 11:07:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:08:04.100830 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:08:04.101835 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-174701d0-0b74-4fc1-a955-c97bb8ba14cb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 10 11:08:04.102236 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 11:08:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:08:04.113033 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:04.486510 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-feaea0d3-b566-4722-ab65-1e57ee7d7f16 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:08:04.506777 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-feaea0d3-b566-4722-ab65-1e57ee7d7f16 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398768 Aug 10 11:08:04.507309 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 10 11:08:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:08:04.530525 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-fa4d8c10-0074-44cc-9e00-20dc047c53e9 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:08:04.534563 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:04.540453 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-fa4d8c10-0074-44cc-9e00-20dc047c53e9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013514 Aug 10 11:08:04.540993 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 10 11:08:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:08:04.552893 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-2d5b16fe-9015-4224-88f8-541fcd5bffd1 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:08:04.570193 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-2d5b16fe-9015-4224-88f8-541fcd5bffd1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019788 Aug 10 11:08:04.570980 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 10 11:08:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:08:04.583400 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:08:04.592841 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012974 Aug 10 11:08:04.593409 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 10 11:08:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:08:04.606704 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-2e215cb3-dcf3-4a27-a6ff-96d9112b3c26 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:08:04.614475 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-2e215cb3-dcf3-4a27-a6ff-96d9112b3c26 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011524 Aug 10 11:08:04.615034 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 10 11:08:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:10:55.907532 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:10:55.908536 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 10 11:10:55.908927 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:10:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:10:56.048936 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=6 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:10:56.207143 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-9d368684-2fba-4162-a10c-236d16a9c4f6 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:10:56.209749 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:10:56.209749 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Aug 10 11:10:56.211022 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-9d368684-2fba-4162-a10c-236d16a9c4f6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:10:56.211502 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-9d368684-2fba-4162-a10c-236d16a9c4f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:10:56.211927 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-9d368684-2fba-4162-a10c-236d16a9c4f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:10:56.212687 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-9d368684-2fba-4162-a10c-236d16a9c4f6 admin admin] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:10:56.213206 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-9d368684-2fba-4162-a10c-236d16a9c4f6 admin admin] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:10:56.213694 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-9d368684-2fba-4162-a10c-236d16a9c4f6 admin admin] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:10:56.247130 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-9d368684-2fba-4162-a10c-236d16a9c4f6 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199660 Aug 10 11:10:56.247677 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 11:10:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:10:57.066701 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:10:57.067692 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 10 11:10:57.068085 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:10:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:10:57.254368 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-c24561e8-4901-42d6-a6a5-f76c4bf0eec2 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:10:57.256794 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:10:57.256794 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Aug 10 11:10:57.257927 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-c24561e8-4901-42d6-a6a5-f76c4bf0eec2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:10:57.258403 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-c24561e8-4901-42d6-a6a5-f76c4bf0eec2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:10:57.258865 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-c24561e8-4901-42d6-a6a5-f76c4bf0eec2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:10:57.259605 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-c24561e8-4901-42d6-a6a5-f76c4bf0eec2 admin admin] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:10:57.260055 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-c24561e8-4901-42d6-a6a5-f76c4bf0eec2 admin admin] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:10:57.260469 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-c24561e8-4901-42d6-a6a5-f76c4bf0eec2 admin admin] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:10:57.279591 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-c24561e8-4901-42d6-a6a5-f76c4bf0eec2 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075149 Aug 10 11:10:57.280129 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 11:10:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:11:08.516622 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:11:08.517657 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 10 11:11:08.518057 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:11:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:11:08.658108 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell0:SELECT=4 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:08.658771 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell1:SELECT=4 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:08.659522 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=8 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:11:08.707225 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-f5038134-5caf-4606-92b0-f46a20790dda admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:11:08.709590 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:11:08.709590 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Aug 10 11:11:08.710718 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-f5038134-5caf-4606-92b0-f46a20790dda admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:11:08.711220 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-f5038134-5caf-4606-92b0-f46a20790dda admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:11:08.711646 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-f5038134-5caf-4606-92b0-f46a20790dda admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:11:08.712886 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-f5038134-5caf-4606-92b0-f46a20790dda admin admin] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:11:08.713333 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-f5038134-5caf-4606-92b0-f46a20790dda admin admin] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:11:08.713748 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-f5038134-5caf-4606-92b0-f46a20790dda admin admin] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:11:08.741165 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-f5038134-5caf-4606-92b0-f46a20790dda admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087409 Aug 10 11:11:08.741733 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 11:11:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:11:09.557684 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:11:09.558720 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-5a2cc1ed-b776-4e92-88ff-1b6657b21f47 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Aug 10 11:11:09.559117 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 11:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:11:09.748341 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-2a46e80c-d19b-4ae6-819f-dea60a31bc28 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:11:09.751000 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:11:09.751000 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Aug 10 11:11:09.752217 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-2a46e80c-d19b-4ae6-819f-dea60a31bc28 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:11:09.752719 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-2a46e80c-d19b-4ae6-819f-dea60a31bc28 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:11:09.753161 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-2a46e80c-d19b-4ae6-819f-dea60a31bc28 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:11:09.753858 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-2a46e80c-d19b-4ae6-819f-dea60a31bc28 admin admin] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:11:09.754302 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-2a46e80c-d19b-4ae6-819f-dea60a31bc28 admin admin] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:11:09.754740 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-2a46e80c-d19b-4ae6-819f-dea60a31bc28 admin admin] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:11:09.777310 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-2a46e80c-d19b-4ae6-819f-dea60a31bc28 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080244 Aug 10 11:11:09.777783 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 11:11:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:12:06.788666 dv-cinder-852724-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 11:12:06.789191 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: Wed Aug 10 11:12:06 2022 - graceful shutdown triggered... Aug 10 11:12:06.789608 dv-cinder-852724-1-iscsi devstack@n-api.service[103462]: Gracefully killing worker 2 (pid: 103462)... Aug 10 11:12:06.790091 dv-cinder-852724-1-iscsi devstack@n-api.service[103461]: Gracefully killing worker 1 (pid: 103461)... Aug 10 11:12:07.790134 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: worker 1 buried after 1 seconds Aug 10 11:12:07.790134 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: worker 2 buried after 1 seconds Aug 10 11:12:07.791307 dv-cinder-852724-1-iscsi devstack@n-api.service[103460]: goodbye to uWSGI. Aug 10 11:12:07.792302 dv-cinder-852724-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 11:12:07.792890 dv-cinder-852724-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 11:12:07.795892 dv-cinder-852724-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 11:12:07.806545 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 11:12:07 2022] *** Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: nodename: dv-cinder-852724-1-iscsi Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: machine: x86_64 Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: clock source: unix Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: pcre jit disabled Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: detected number of CPU cores: 4 Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: current working directory: / Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: detected binary path: /usr/bin/uwsgi-core Aug 10 11:12:07.809143 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: your processes number limit is 47680 Aug 10 11:12:07.809848 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: your memory page size is 4096 bytes Aug 10 11:12:07.809848 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: detected max file descriptor number: 2048 Aug 10 11:12:07.809848 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: lock engine: pthread robust mutexes Aug 10 11:12:07.809848 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: thunder lock: enabled Aug 10 11:12:07.809848 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 11:12:07.809848 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 11:12:07.847721 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: Python main interpreter initialized at 0x55f5988649c0 Aug 10 11:12:07.847721 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: python threads support enabled Aug 10 11:12:07.847721 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: your server socket listen backlog is limited to 100 connections Aug 10 11:12:07.847721 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: your mercy for graceful operations on workers is 90 seconds Aug 10 11:12:07.848132 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 11:12:07.848132 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: *** Operational MODE: preforking *** Aug 10 11:12:07.848398 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: *** uWSGI is running in multiple interpreter mode *** Aug 10 11:12:07.848398 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: spawned uWSGI master process (pid: 117908) Aug 10 11:12:07.848597 dv-cinder-852724-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 11:12:07.851941 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: spawned uWSGI worker 1 (pid: 117919, cores: 1) Aug 10 11:12:07.851941 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: spawned uWSGI worker 2 (pid: 117920, cores: 1) Aug 10 11:12:07.851941 dv-cinder-852724-1-iscsi devstack@n-api.service[117908]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 11:12:08.511896 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:12:08.579168 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:12:09.682298 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:12:09.682298 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Aug 10 11:12:09.682987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:12:09.682987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Aug 10 11:12:09.734774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:12:09.734774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: from cryptography.utils import int_from_bytes Aug 10 11:12:09.735378 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:12:09.735378 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: from cryptography.utils import int_from_bytes Aug 10 11:12:12.019499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:12:12.020490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:12:12.021069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:12:12.021461 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:12:12.021722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:12:12.022155 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.022647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.022982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.023312 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.023700 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.024018 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.024465 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.024864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.025697 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.025959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.026278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.026622 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852724-1-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.026951 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.027263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.027594 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.027920 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.028226 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.028553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.028859 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.029362 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.030775 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.030775 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.030997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.031271 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.031563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.031917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.032234 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.032696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.033023 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.033334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.033741 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852724-1-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.034064 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.034515 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.034915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.035345 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.035669 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.035978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.036300 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.036628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.036947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.037277 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.037600 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.037926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.038248 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.038550 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.038887 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.039199 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.039521 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.039839 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.040147 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.040398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.040714 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.041759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.042087 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.042415 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.042824 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.043081 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.043403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.043784 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.044103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.044440 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.044752 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.045234 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.045544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.045853 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.046166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.046476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.046820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.047136 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.047462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.047768 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.048088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.048493 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.048743 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.049050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.049394 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.049713 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.050023 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.050344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.050686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.050996 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.051304 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.051608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.051932 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.052263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.052569 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.052934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.053492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.053804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.054379 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.054949 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.055471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.055785 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.056146 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.056513 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.056827 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.057136 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.057445 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.057757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.058064 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.058383 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.058704 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.059009 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.059332 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.059653 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.059969 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.060276 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.060585 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.060891 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.061211 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.061516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.061823 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.062190 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.062450 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.062780 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.063259 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.063567 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.063875 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.064194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.064498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.064806 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.065127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.065434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.066380 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.066721 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.067031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.067340 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.067648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.067955 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.068261 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.068563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.068886 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.069211 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.069522 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.069829 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.070136 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.070456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.070916 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.071157 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.071504 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.071887 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.072719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.073154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.073401 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.073714 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.074032 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.074360 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.074700 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.075016 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.075332 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.075813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.076146 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.076480 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.076801 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.077120 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.077440 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.077753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.078071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.078499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.078740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.079053 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.079397 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.079773 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.080088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.080413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.080739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.081054 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.081362 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.081673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.081997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.082332 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.082738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.082990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.083311 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.083610 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.083920 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.084660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.084660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.084973 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.085170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.085502 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.085791 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.086186 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.086425 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.086760 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.087073 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.087378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.088294 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.088605 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.088917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.089224 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.089672 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.090008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.090385 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.090745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.091057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.091372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.091686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.091999 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.092305 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.092619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.092931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.093269 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.093541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.093844 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.094150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.094475 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.094806 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.095111 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.095428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.095741 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.096051 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.096371 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.096772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.097038 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.097317 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.097629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.097965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.098296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.098694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.099048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.099371 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.099689 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.099991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.100299 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.100603 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.100909 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.101212 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.101520 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.101823 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.102127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.102429 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.102756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.103074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.103383 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.103680 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.103983 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.104287 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.104589 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.105591 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.105591 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.105591 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.106142 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.106293 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.106563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.106917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.107232 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.107546 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.107916 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.108235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.108549 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.108869 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.109181 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.109502 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.109812 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.110139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.110448 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.110819 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.111126 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.111443 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.111786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.112170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.112434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.112758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.113121 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.113384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.113734 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.114048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.114362 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.114699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.115020 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.115330 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.115724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.116039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.116349 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.116664 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.117067 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.117328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.117643 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.117976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.118309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.118640 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.119098 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.119270 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.119663 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.119903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.120217 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.120522 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.120830 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.121141 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.121457 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.121769 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.122080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.122387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.122722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.123035 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.123342 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.123647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.123958 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.124280 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.124589 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.124911 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.125232 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.125536 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.125841 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.126161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.126475 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.126811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.127147 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.127451 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.127793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.128105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.128408 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.128722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.129042 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.129351 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.129666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.129974 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.130283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.130623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.130938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.131247 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.131557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.131866 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.132174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.132481 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.132802 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.133109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.133417 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.133725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.134027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.134336 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.135160 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.135737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.136070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.136391 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.136709 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.137026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.137343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.137672 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.137996 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.138343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.138686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.138986 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.139290 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.139595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.139907 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.140211 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.140516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.140819 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.141129 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.141434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.141737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.142040 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.142343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.142704 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.143012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.143323 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.143647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.143969 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.144299 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.144602 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.146623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.146623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.146623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.146623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.146623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.147024 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.147242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.147555 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.147862 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.148192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.148499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.148805 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.149111 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.149424 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.149735 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.150040 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.150441 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.150818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.151088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.151420 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.151727 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.152059 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.152365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.152724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.153007 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.153312 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.153617 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.153941 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.154262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.154565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.154945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.155235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.155786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.155903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.156165 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.156531 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.156804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.157114 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.157419 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.157744 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.158057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.158363 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.158691 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.159004 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.159309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.159614 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.159924 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.160247 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.160565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.160870 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.161181 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.161484 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.161791 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.162094 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.162402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.162730 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.163038 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.163341 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.163644 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.163950 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.164288 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.164579 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.164883 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.165187 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.165490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.166501 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.166719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.167036 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.167346 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.167659 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.167979 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.168289 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.168601 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.168916 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.169221 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.169537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.169850 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.170164 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.170471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.170808 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.171133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.171446 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.171757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.172079 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.172403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.172727 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.173033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.173340 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.173651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.173963 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.174270 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.174602 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.174908 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.175219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.175572 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.175861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.176172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.176477 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.176795 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.177104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.177408 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.177732 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.178042 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.178651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.178980 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.179487 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.179624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.179890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.180324 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.180637 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.180948 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.181259 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.182140 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.182454 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.182794 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.183161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.183418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.184729 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.184729 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.184729 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.185896 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.186465 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.187016 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.187519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.188048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.188571 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.189072 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.189585 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.190081 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.190471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.190838 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.191386 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.191603 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.191920 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.192353 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.192675 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.192997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.193329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.193663 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.193991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.194303 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.194648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.194967 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.195297 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.195631 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.195947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.196269 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.196582 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.196919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.197286 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.197606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.197935 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.198358 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.198710 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.199036 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.199365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.199699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.200010 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.200319 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.200651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.200942 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.201251 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.201582 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.201890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.202205 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.202522 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.202861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.203169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.203477 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.203803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.204110 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.204434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.204751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.205075 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.205417 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.205712 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.206035 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.206348 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.206683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.206997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.207303 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.207647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.208011 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.208345 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.208678 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.209011 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.209326 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.209661 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.209989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.210308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.210724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.211057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.211365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.211672 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.211984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.212293 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.212623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.212933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.213245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.213551 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.213866 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.214187 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.214532 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.214872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.215197 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.215567 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.215839 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.216146 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.216452 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.216806 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.217116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.217446 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.217758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.218085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.218476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.218738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.219056 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.219374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.219690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.220005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.220320 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.220632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.221053 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.221262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.221411 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:12:12.221977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.222079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:12:12.222165 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.222315 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:12:12.222471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.222673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:12:12.222833 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.222926 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:12:12.223167 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.223340 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.223669 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.223781 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.223991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.224089 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.224309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.224420 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.224624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.224731 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.224938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.225040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.225253 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.225459 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.225605 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.225768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.225944 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.226130 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.226295 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.226439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.226636 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.226746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.227010 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.227206 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852724-1-iscsi {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.227370 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.227534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.227680 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.227786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.227969 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.228074 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.228805 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.228915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.229165 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.229270 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.229515 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.229632 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.229825 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.230016 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.230151 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.230358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.230479 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.230725 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.230839 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.231079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.231333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.231569 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.231733 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.231917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.232174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.232294 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.232394 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.232521 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.232699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.232699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.232873 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.233025 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.233140 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.233344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.233507 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.233689 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.233846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.234026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.234239 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852724-1-iscsi {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.234382 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.234485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.234721 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.234853 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.235039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.235214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.235360 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.235657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.235884 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.235985 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.236200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.236335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.236532 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.236683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.236858 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.237055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.237200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.237388 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.237489 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.237748 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.237856 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.238087 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.238196 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.238406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.238507 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.238741 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.238863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.239057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.239165 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.239368 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.239463 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.239674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.239776 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.239997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.240100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.240306 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.240401 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.240612 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.240705 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.240929 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.241049 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.241238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.241355 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.241609 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.241771 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.241934 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.242124 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.242294 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.242447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.242550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.242804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.242908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.243133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.243238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.243455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.243577 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.243767 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.243981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.244150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.244319 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.244462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.244684 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.244855 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.245008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.245189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.245345 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.245503 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.245702 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.245805 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.246054 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.246149 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.246402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.246534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.246736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.246838 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.247044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.247146 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.247362 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.247455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.247668 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.247770 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.247995 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.248096 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.248304 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.248550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.248653 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.248847 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.248948 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.249184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.249288 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.249499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.249592 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.249805 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.249905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.250111 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.250211 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.250418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.250548 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.250758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.250926 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.251064 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.251266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.251369 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.251613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.251752 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.251952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.252106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.252329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.252472 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.252624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.252773 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.252918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.253068 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.253217 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.253376 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.253520 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.253671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.253813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.253956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.254110 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.254253 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.254392 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.254530 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.254727 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.254867 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.255027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.255175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.255405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.255552 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.255701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.255852 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.255997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.256145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.256413 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.256556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.256756 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.256908 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.257114 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.257273 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.257446 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.257611 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.257777 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.257884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.258091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.258212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.258416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.258529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.258764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.258869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.259132 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.259252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.259409 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.260034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.260244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.260335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.260557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.260639 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.260869 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.260970 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.261180 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.261317 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.261494 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.261590 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.261806 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.261933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.262113 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.262323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.262432 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.262810 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.263001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.263171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.263353 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.263720 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.264064 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.264407 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.264512 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.264746 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.264863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.265073 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.265182 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.265404 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.265501 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.265748 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.265848 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.266078 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.266185 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.266404 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.266497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.266760 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.266952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.267122 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.267284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.267432 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.267580 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.267737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.267889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.268070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.268236 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.268378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.268572 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.268712 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.268900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.269051 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.269261 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.269400 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.269575 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.269719 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.269922 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.270071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.270276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.270413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.270614 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.270762 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.270942 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.271096 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:12:12.271253 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.271412 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.271553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.271703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.271872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.272055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.272210 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.272405 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.272567 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.272782 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.272949 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.273104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.273245 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.273436 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.273584 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.273765 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.273919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.274091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.274230 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.274398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.274543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.274894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.275035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.275764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.275920 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.276015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.276113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.276237 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.276410 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.276549 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.276807 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.276914 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.277139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.277250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.277446 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.277547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.277757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.277859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.278062 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.278170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.278369 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.278516 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.278701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.278891 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.278998 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.279270 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.279402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.279595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.279687 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.279901 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.280010 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.280204 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.280573 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.280666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.280750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.280843 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.281002 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.281131 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.281358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.281486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.281673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.281765 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.281976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.282078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.282278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.282408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.282613 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.282749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.282955 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.283088 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.283288 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.283470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.283604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.283814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.283932 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.284165 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.284267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.284531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.284624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.284850 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.284981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.285172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.285267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.285493 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.285588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.285810 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.285954 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.286120 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.286264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.286453 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.286663 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.286773 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.287005 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.287120 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.287344 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.287437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.287688 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.287789 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.288000 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.288103 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.288310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.288403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.288637 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.288732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.288966 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.289060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.289272 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.289373 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.289599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.289718 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.290033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.290145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.290357 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.290538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.290759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.290914 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.291071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.291325 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.291488 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.291644 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.291961 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.292272 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.294347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.294529 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.294729 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.294898 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295075 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295431 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295525 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295617 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295796 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.295888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.296158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.296267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.296364 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.296460 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.296556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.296651 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.296745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.296831 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.296923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297424 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.297963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.298048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.298163 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.298269 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.298405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:12:12.298506 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.298981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.299324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.299667 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.300017 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.300390 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.300769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.301115 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.301432 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.301769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.302107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.302468 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.302902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.303179 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.303757 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.304113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.304428 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.304769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.305117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.305450 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.305798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.306174 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.306489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.306889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.307238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.307575 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.307905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.308229 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.308612 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.308928 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.309321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.309766 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.310056 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.310416 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.310862 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.311225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.311580 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.311904 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.312224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.312564 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.313119 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.313411 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.313621 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.313961 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.314448 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.314712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.315046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.315399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.315741 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.316568 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.316568 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.316865 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.317186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.317545 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.317910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.318243 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.318601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.318943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.319287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.319650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.320008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.320337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.320828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.321065 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.321385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.321733 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.322643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.322943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.323503 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.324337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.324337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.324337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.324774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.325005 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.325324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.325726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.326023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.326473 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.326747 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.327079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.327648 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.327865 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.328260 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.328610 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.328992 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.329355 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.329694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.330106 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.330391 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.330775 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.331151 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.331495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.331832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.332184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.332539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.332929 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.333306 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.333775 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.333949 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.334267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.334629 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.334947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.335316 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.335694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.336009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.336360 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.336705 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.337062 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.337436 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.338358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.338828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.339173 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.340046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.340046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.340567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.340567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.340973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.341178 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.341520 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.341874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.342215 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.342564 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.343252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.343633 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.344071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.344302 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.344679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.345047 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.345448 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.345789 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.346158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.346496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.346888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.347216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.347571 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.347911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.348246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.348624 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.348907 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.349246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.349587 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.349916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.350268 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.350683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.351049 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.351279 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.351622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.351945 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.352306 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.352647 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.352961 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.353341 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.353657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.354027 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.354318 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.354807 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.355077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.355447 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.355797 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.356132 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.356503 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.356825 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.357152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.357469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.357837 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.358170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.358498 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.358883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.359220 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.359576 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.359914 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.360244 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.360651 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.360921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.361270 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.361622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.361943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.362264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.362640 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.362983 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.363574 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.363852 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.364040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.364331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.364623 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.364956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.365256 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.365573 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.365933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.366232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.366611 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.366968 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.367306 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.367647 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.367984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.368314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.368644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.369028 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.369375 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.369738 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.370090 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.370430 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.370830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.371183 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.371535 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.371891 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.372282 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.372574 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.372904 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.373216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.373562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.373921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.374375 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.374741 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.374957 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.375304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.375662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.376006 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.376402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.376755 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.377110 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.377463 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.377806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.378146 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.378487 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.378846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.379232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.379563 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.379903 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.380227 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.380573 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.380947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.381270 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.381621 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.381985 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.388878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.388878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.388878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.388878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.388878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.388878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.388878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.388878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.391538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.391538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.391538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.391538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.391538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.391538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.391538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.391538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.393314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.393314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.393314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.393314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.393314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.393314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.393314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.393314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.394374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.394374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.394374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.394374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.394374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.394374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.394374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.394374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.396050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.396050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.396050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.396050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.396050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.396050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.396050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.397079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.397079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.397079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.397500 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.397500 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.397869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.398250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.398441 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.399048 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.399280 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.399633 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.400158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.401036 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.401360 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.401713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.402130 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.402452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.402841 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.403188 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.403653 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.403853 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.404221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.404554 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.404901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.405225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.405610 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.405952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.406275 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.406664 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.407143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.407517 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.407873 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.408319 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.408583 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.410093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.410093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.410093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.410093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.410794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.410794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.411133 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.411293 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.411562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.411916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.412346 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.412581 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.412929 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.413261 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.413626 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.413950 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.414281 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.414653 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.414989 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.415343 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.415750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.416084 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.416434 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.416771 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.417159 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.417474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.417803 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.418162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.418545 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.418903 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.419266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.419622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.419964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.420329 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.420683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.421034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.421364 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.421701 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.422036 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.422445 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.422732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.423091 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.423443 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.423792 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.424145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.424486 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.424839 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.425187 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.425551 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.425894 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.426235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.426549 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.426963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.427314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.427653 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.428005 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.429301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.429301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.429301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.430376 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.430376 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.430376 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.430975 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.431140 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.431870 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.432229 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.432627 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.432936 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.433563 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.433915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.434276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.434723 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.435082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.435444 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.435805 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.436150 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.436505 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.436846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.437201 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.437559 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.437908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.438277 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.438670 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.438970 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.439315 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.439673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.440018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.440404 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.442267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.442267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.442267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.442267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.443182 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.443182 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.443182 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.443728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.443728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.444104 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.444401 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.444772 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.445100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.445462 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.445807 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.446186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.446528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.446916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.447400 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.447996 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.448353 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.448762 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.449077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.449433 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.449794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.450139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.450497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.450991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.451351 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.451694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.452035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.452385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.452910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.453091 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.453414 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.453773 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Registered counter for database nova_api Aug 10 11:12:12.453943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.454126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.454703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.455079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.455441 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.455798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.456194 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.456516 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.456870 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.457221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.457574 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.457910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.458272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.458630 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.458985 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.459326 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.459662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.459997 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.460325 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.460667 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.461009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.461375 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.461727 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.462063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.462387 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.463300 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.463617 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.463970 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.464304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.464641 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.464996 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.465310 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.465647 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.465983 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.466327 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.466701 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.469233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.469233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.469233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.469233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.469233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.469233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.469233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.470682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.470682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.470682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.470682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.471389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.471558 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.471793 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.472145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.472531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.472908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.473474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.473703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.474037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.474259 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.474563 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.474996 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.475264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.475575 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.475933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.476272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.476544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:12:12.476758 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.476947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.477369 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.477636 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.477995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.479045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.479392 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.479750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.480148 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.480475 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.480810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.481339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.481686 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.481841 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.482170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.482510 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.482888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.483249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.483686 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.484021 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.484342 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:12:12.484527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.484695 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.485112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.485395 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.485754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.486104 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.486444 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.486860 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.487193 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.487530 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.487895 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.488212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.488550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.488895 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.489249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.490044 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.490044 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.490364 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.490615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.490952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.491298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.491629 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.491959 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.492829 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.492829 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.493150 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.493301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.493567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.493944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.494531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.494917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.495239 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.495571 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.495903 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.496269 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.496585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.496949 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.497286 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.497633 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.497968 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.498320 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.498675 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.499071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.499448 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.499798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.500149 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.500536 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.500853 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.501190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.501588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.501912 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.502300 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.502641 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.503025 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.503361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.503715 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.504073 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.504371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.504700 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.505040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.505534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.505739 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.506091 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.506449 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.506847 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.507192 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.507538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.507886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.508224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.508543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.508898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.509237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.509586 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.509940 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.510276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.510656 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.511011 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.511358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.511700 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.512055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.512410 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.512748 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.513122 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.513478 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.513869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.514228 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.514622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.515003 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.515349 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.515728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.516084 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:12:12.516407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:12:12.547351 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.context [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9412f8ab-5880-4cdf-b6de-459533ed5749(cell1) {{(pid=117920) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:12:12.551363 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:12:12.551841 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:12:12.553675 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:12:12.554402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:12:12.554873 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:12:12.556860 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:12:12.558839 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Registered counter for database nova_cell0 Aug 10 11:12:12.563041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Registered counter for database nova_cell1 Aug 10 11:12:12.570673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:12:12.572478 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:12:12.578217 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:12:12.581060 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:12:12.677266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Registered counter for database nova_api Aug 10 11:12:12.698263 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:12:12.704800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:12:12.734956 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Registered counter for database nova_cell0 Aug 10 11:12:12.742276 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:12:12.746726 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:12:12.762446 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.context [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9412f8ab-5880-4cdf-b6de-459533ed5749(cell1) {{(pid=117919) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:12:12.766342 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:12:12.766846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:12:12.768461 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:12:12.769175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:12:12.769618 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:12:12.771645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:12:12.773621 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Registered counter for database nova_cell0 Aug 10 11:12:12.778124 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Registered counter for database nova_cell1 Aug 10 11:12:12.785067 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:12:12.787366 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:12:12.793004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:12:12.795726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:12:12.943977 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Registered counter for database nova_cell0 Aug 10 11:12:12.951233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:12:12.955707 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:12:13.062961 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:12:13.070263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:12:13.274012 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:12:13.281820 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:12:13.410605 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:12:13.416664 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-efd47d66-9948-4279-8434-63978eb589c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:12:13.422869 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5988649c0 pid: 117920 (default app) Aug 10 11:12:13.624964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:12:13.630954 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-27f0b4f0-63d6-46ba-8b20-30ffae9ba78a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:12:13.636311 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5988649c0 pid: 117919 (default app) Aug 10 11:12:52.873965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:52.877657 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:52.878762 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:52.880417 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:53.228157 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d12c904-abcd-4021-902d-68bea83f56e1 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf98e5a60>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:12:53.991097 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d12c904-abcd-4021-902d-68bea83f56e1 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/a29041a8-9ee8-48a5-af84-fdd58d60dee6" status: 200 len: 350 microversion: 2.1 time: 1.141941 Aug 10 11:12:53.992739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 1/1] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:12:52 2022] GET /compute/v2.1/os-volumes/a29041a8-9ee8-48a5-af84-fdd58d60dee6 => generated 350 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:12:54.693649 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:54.695279 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:54.696869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:54.697836 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:12:55.344161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-945327650", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:12:56.423452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] validate_networks() for [('49acdff1-cbf0-4921-a092-bf7cdfa7544c', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:12:58.838171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:12:58.838784 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:12:58.841273 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:12:58.844128 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:12:58.846452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:12:58.892892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:12:58.893661 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:12:58.894625 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:12:58.895774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:12:58.896670 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:12:58.897325 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:12:58.953555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Getting quotas for project 429a80ecb8464ef3ad67a23a06fc10f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:12:58.965500 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Getting quotas for user 5d1368fb915444b599b3fcf3f5586789 and project 429a80ecb8464ef3ad67a23a06fc10f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:12:59.027119 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:12:59.042082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:12:59.224125 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cd7d0b52-4f80-4e2b-9fcc-cc8b2326c55a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.567703 Aug 10 11:12:59.225027 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 1/2] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:12:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 4571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:12:59.240668 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7cdc977d-55ca-4d16-ac57-c91d8604c076 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:12:59.241429 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7cdc977d-55ca-4d16-ac57-c91d8604c076 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:12:59.602374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7cdc977d-55ca-4d16-ac57-c91d8604c076 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:12:59.628601 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7cdc977d-55ca-4d16-ac57-c91d8604c076 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1221 microversion: 2.1 time: 0.395084 Aug 10 11:12:59.645546 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:12:59 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1221 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:12:59.995857 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-94255669", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:00.111869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] validate_networks() for [('49acdff1-cbf0-4921-a092-bf7cdfa7544c', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:13:01.374334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:13:01.374972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:13:01.375259 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:13:01.375676 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:13:01.376096 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:13:01.390394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:01.390916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:01.395235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:01.396291 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:01.396763 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:01.397194 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:01.446201 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Getting quotas for project 429a80ecb8464ef3ad67a23a06fc10f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:13:01.457158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Getting quotas for user 5d1368fb915444b599b3fcf3f5586789 and project 429a80ecb8464ef3ad67a23a06fc10f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:13:01.480379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:13:01.482538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:13:01.601899 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-054ad28e-3a9f-4108-8bad-7356a0655d1b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.611524 Aug 10 11:13:01.603290 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 2/4] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:12:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:13:01.613688 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e836889-3222-43c1-8679-3a2cb0cc8e8c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:01.615131 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e836889-3222-43c1-8679-3a2cb0cc8e8c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:01.657154 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-34b6eb9c-656f-4dac-8290-d5eed3d8f9e7 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf85ed550>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:01.789567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-34b6eb9c-656f-4dac-8290-d5eed3d8f9e7 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b6393a3e-1e79-4486-8b28-d37251677ea4" status: 200 len: 351 microversion: 2.1 time: 0.137181 Aug 10 11:13:01.790034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:13:01 2022] GET /compute/v2.1/os-volumes/b6393a3e-1e79-4486-8b28-d37251677ea4 => generated 351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:13:01.988530 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7e836889-3222-43c1-8679-3a2cb0cc8e8c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:01.999047 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e836889-3222-43c1-8679-3a2cb0cc8e8c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1220 microversion: 2.1 time: 0.389075 Aug 10 11:13:02.010693 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:01 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1220 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:03.024723 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cedd0b6c-2bad-4440-a5fc-5fb7fce857d5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:03.032762 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cedd0b6c-2bad-4440-a5fc-5fb7fce857d5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:03.703931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-49661c8d-27ca-4969-95dc-e9ea587b9573 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf96afe50>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:03.735541 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cedd0b6c-2bad-4440-a5fc-5fb7fce857d5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:03.762079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cedd0b6c-2bad-4440-a5fc-5fb7fce857d5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1220 microversion: 2.1 time: 0.741092 Aug 10 11:13:03.764850 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:03 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1220 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:03.818889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-49661c8d-27ca-4969-95dc-e9ea587b9573 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f12e7ae5-d3a2-4669-b7d7-8f98441f5c7f" status: 200 len: 351 microversion: 2.1 time: 0.118834 Aug 10 11:13:03.819703 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:13:03 2022] GET /compute/v2.1/os-volumes/f12e7ae5-d3a2-4669-b7d7-8f98441f5c7f => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:03.833325 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cef2dba8-d057-4250-a807-34daf84b7273 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf85e1ee0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:04.019392 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cef2dba8-d057-4250-a807-34daf84b7273 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.189983 Aug 10 11:13:04.019966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 5/9] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 10 11:13:03 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:04.036488 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-559048d1-29f6-454c-ba02-78376a904906 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf97224c0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:04.238275 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-559048d1-29f6-454c-ba02-78376a904906 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.206066 Aug 10 11:13:04.239794 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 10 11:13:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:04.254024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9a7139a0-cbd0-4981-9241-3de22087ce0e tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccfa06ed30>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:04.455846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9a7139a0-cbd0-4981-9241-3de22087ce0e tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.205750 Aug 10 11:13:04.456768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 10 11:13:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:04.471244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ceade63a-4afc-4257-a840-e3c393e46975 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf96afc10>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:04.784872 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:04.785506 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:04.795337 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ceade63a-4afc-4257-a840-e3c393e46975 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.329216 Aug 10 11:13:04.796343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 10 11:13:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:04.810289 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:04.813548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3192e45a-6290-4251-9c69-b09c7ea72752 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf97220d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:04.815037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:04.815601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:04.816394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:04.819974 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:04.820976 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:05.064994 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3192e45a-6290-4251-9c69-b09c7ea72752 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.259385 Aug 10 11:13:05.065858 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 10 11:13:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:05.079161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9f2acdc4-1fd7-484a-9de1-8b3308e817dc tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf96ce0d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:05.301466 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:05.304803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9f2acdc4-1fd7-484a-9de1-8b3308e817dc tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.229294 Aug 10 11:13:05.305644 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 8/14] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 10 11:13:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:05.319349 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4ae943e8-9c6b-4250-b567-07edbdc813d7 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf96d0310>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:05.331993 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7fd80324-6d36-49aa-ab6c-5d1a3e3432b5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1216 microversion: 2.1 time: 0.551090 Aug 10 11:13:05.343064 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 7/15] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:04 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1216 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:05.562336 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4ae943e8-9c6b-4250-b567-07edbdc813d7 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.247232 Aug 10 11:13:05.564565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 9/16] 10.222.0.49 () {58 vars in 1188 bytes} [Wed Aug 10 11:13:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:05.579186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cd81c36b-6f9d-466c-b944-bd80551f6219 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] Calling method '.version_select at 0x7fccf84ea820>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:05.734807 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cd81c36b-6f9d-466c-b944-bd80551f6219 tempest-VolumesTestJSON-14942496 tempest-VolumesTestJSON-14942496-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.159585 Aug 10 11:13:05.735397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 8/17] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 10 11:13:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:06.364148 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:06.365402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:06.379492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:06.380005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:06.380452 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:06.381537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:06.383542 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:06.385536 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:06.677398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:06.731599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a1f58edf-1a04-4e44-a5ef-45ebfb952b92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1216 microversion: 2.1 time: 0.371757 Aug 10 11:13:06.732455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 10/18] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:06 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1216 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:07.760465 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:07.761083 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:07.791643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:07.792378 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:07.792971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:07.793846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:07.794449 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:07.795054 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:08.004435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:08.013083 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-496bb21f-d1ff-46f3-8c8c-9405a04cfe4c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1216 microversion: 2.1 time: 0.257126 Aug 10 11:13:08.014816 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 9/19] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:07 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:08.374847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8dcf0c84-2500-40c1-b3c4-764dd4be60cf tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: .version_select at 0x7fccf963cd30>, body: {"keypair": {"name": "tempest-keypair-1021702183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwV7MnZtb5gqTZzWPv7YQE5Il/JiiOohC8v5kAi4UAuv8XwoPrWRNcHROVKYLwLRM6E5IAw7KDSWV5sb91X13W33AosqXafsxoxhr4fhf7+FaJ2i+5/u5CeOrAddjQO+A=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:08.528481 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8dcf0c84-2500-40c1-b3c4-764dd4be60cf tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:13:08.542298 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8dcf0c84-2500-40c1-b3c4-764dd4be60cf tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for user 0a30897a10d8467aa294f24954368a84 and project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:13:08.639697 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8dcf0c84-2500-40c1-b3c4-764dd4be60cf tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.570617 Aug 10 11:13:08.640673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:13:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:09.039316 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:09.039932 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:09.062076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:09.075999 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:09.077822 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:09.079712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:09.079712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:09.091834 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:09.374799 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:09.399090 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9fcb5aa7-ad2d-4b00-9ae2-5bc19ea96d12 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1272 microversion: 2.1 time: 0.369003 Aug 10 11:13:09.403073 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 10/21] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:09 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:10.442215 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:10.444739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:10.460527 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:10.472411 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:10.473215 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:10.475421 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:10.479773 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:10.481425 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:10.789690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:10.816395 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d30ac9ba-a48f-4897-b547-c6238d2a3ff2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1278 microversion: 2.1 time: 0.397684 Aug 10 11:13:10.822339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 12/22] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:10 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1278 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:11.412555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:11.622564 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1968490629", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "networks": [{"uuid": "4c05a4a3-fc39-4cdb-be0d-6681b73bfa06"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:11.739877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] validate_networks() for [('4c05a4a3-fc39-4cdb-be0d-6681b73bfa06', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:13:11.847437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:11.848109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:11.880940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:11.883454 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:11.885625 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:11.886651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:11.889679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:11.890516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:12.385516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:12.399050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d95284e2-c9a3-407f-8ad2-47af50cf7e76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1278 microversion: 2.1 time: 0.556045 Aug 10 11:13:12.418118 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 13/23] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:11 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1278 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:13.703857 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a0270fc9-34d8-4e25-96e2-68a6473c6e84 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'create', calling method: .version_select at 0x7fccf8d2ef70>, body: {"keypair": {"name": "tempest-keypair-1523387340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8rU1SKfNhbTgFlWGwQhdYlqPjdkZDHz01SEen8k1ovLQxhx0B/N1l+EUQgEv+TNZhJLJqc3/Pm0GGNelJXCJ4euzOR2USOGhXUDOFW/hSduhuiDVaN9p21gNRdeJtvlQ=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:13.742893 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a0270fc9-34d8-4e25-96e2-68a6473c6e84 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Getting quotas for project c66f397e080f497da06b661ea1a87e03. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:13:13.761771 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=14 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:13.767622 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a0270fc9-34d8-4e25-96e2-68a6473c6e84 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Getting quotas for user 951cabf887f14896b0c4402b686be697 and project c66f397e080f497da06b661ea1a87e03. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:13:13.820504 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a0270fc9-34d8-4e25-96e2-68a6473c6e84 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.604837 Aug 10 11:13:13.823246 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 14/24] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:13:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:13:13.844286 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:13.857046 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:13.877760 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:13.898319 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:13.899500 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:13.902087 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:13.903972 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:13.904666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:14.457211 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:13:14.457804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:13:14.458351 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:13:14.459010 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:13:14.459694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:13:14.484340 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:14.489189 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:14.490223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:14.492791 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:14.494042 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:14.494781 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:14.498281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:14.510430 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e4b80f5-44cd-4e28-b9c7-d0a4f3afc87a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1278 microversion: 2.1 time: 0.676447 Aug 10 11:13:14.511174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 15/25] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:13 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1278 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:14.562362 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Getting quotas for project 450e17cbc2104fcba833fc48ada83cda. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:13:14.582558 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Getting quotas for user a59246460c1846ac82200f4516f2507f and project 450e17cbc2104fcba833fc48ada83cda. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:13:14.647918 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:13:14.651199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:13:14.719234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-04aebd0d-86a7-4965-898a-7be3fbe67df7 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.650513 Aug 10 11:13:14.721010 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 11/26] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:13:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:13:14.733080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6586b35c-889c-4f22-9c49-463beee93c44 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:14.733703 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6586b35c-889c-4f22-9c49-463beee93c44 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:15.062137 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6586b35c-889c-4f22-9c49-463beee93c44 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:15.069235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6586b35c-889c-4f22-9c49-463beee93c44 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1215 microversion: 2.1 time: 0.339866 Aug 10 11:13:15.071212 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 16/27] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:14 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:15.532664 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:15.534198 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:15.550704 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:15.557226 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:15.559139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:15.562251 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:15.564981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:15.566790 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:15.997545 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:16.008832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9a12dabf-d7b9-4d3e-abfe-3c1858f7b201 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.480584 Aug 10 11:13:16.009934 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 12/28] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:15 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:16.091859 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:16.092544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:16.104424 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:16.105133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:16.106765 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:16.108870 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:16.109510 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:16.112284 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:16.137007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-236661962", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7551c29-e5c9-4c19-8306-42621bf3d395"}], "security_groups": [{"name": "tempest-securitygroup--965445124"}], "key_name": "tempest-keypair-1021702183", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:16.272156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:16.282053 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6181cfb7-40cd-4ec2-9546-c39f9962fa5e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1219 microversion: 2.1 time: 0.193752 Aug 10 11:13:16.294623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 17/29] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:16 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1219 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:16.389769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] validate_networks() for [('b7551c29-e5c9-4c19-8306-42621bf3d395', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:13:17.032459 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:17.033307 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:17.044112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:17.051550 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:17.054365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:17.057819 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:17.061712 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:17.062266 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:17.941075 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:17.950441 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f8a9d31-ea04-4f01-b029-10da309acc62 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.922852 Aug 10 11:13:17.951103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 18/30] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:17 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:17.997082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:18.005161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:18.040057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:18.041350 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:18.048814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:18.056135 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:18.057145 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:18.058057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:18.565601 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:18.579236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dc9e3a9f-1538-4c95-a7ce-d4692f2a12ea tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1219 microversion: 2.1 time: 0.627075 Aug 10 11:13:18.590836 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 19/31] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:17 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1219 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:18.615626 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:13:18.616664 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:13:18.617482 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:13:18.619002 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:13:18.619631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:13:18.641013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1664096787", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "314bd9c0-3648-481f-8543-275a17b2db6e"}], "security_groups": [{"name": "tempest-securitygroup--1168451300"}], "key_name": "tempest-keypair-1523387340", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:18.664762 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:18.677523 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:18.681288 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:18.695214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:18.702181 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:18.705135 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:18.857410 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:13:18.894425 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for user 0a30897a10d8467aa294f24954368a84 and project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:13:18.940818 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:13:18.963166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:13:19.147015 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-67f78e5d-576f-4fc4-ab2e-154c64aee859 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.014758 Aug 10 11:13:19.151272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 13/32] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:13:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 3020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:13:19.160615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:19.162309 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:19.177808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:19.178330 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:19.178822 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:19.179805 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:19.180266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:19.183750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:20.346331 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] validate_networks() for [('314bd9c0-3648-481f-8543-275a17b2db6e', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:13:21.335292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:21.348682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b200e0f3-d171-4460-99fa-45f9cc809c41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 2.195836 Aug 10 11:13:21.350768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 14/33] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:19 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:21.362721 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:21.362721 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:21.380285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:21.381024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:21.385589 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:21.390649 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:21.391428 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:21.392077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:21.950995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:21.964240 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4502f11f-d387-4c8d-81ea-6d5a96285fe8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1293 microversion: 2.1 time: 0.612786 Aug 10 11:13:21.967237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 15/34] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:21 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1293 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:21.979110 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:21.981446 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:21.994441 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:21.995035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:21.995529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:22.003484 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:22.003962 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:22.004403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:22.167672 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:22.179228 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2f072bdb-4219-4b95-a293-7118250431ab tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1273 microversion: 2.1 time: 0.210434 Aug 10 11:13:22.184646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 16/35] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:21 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:22.398898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:22.402774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:22.451518 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:22.452029 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:22.455803 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:22.457707 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:22.464908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:22.466380 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:22.542208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:13:22.542840 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:13:22.551626 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:13:22.555624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:13:22.556724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:13:22.574250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:22.574978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:22.579474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:22.581077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:22.582051 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:22.582637 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:22.619296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Getting quotas for project c66f397e080f497da06b661ea1a87e03. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:13:22.631823 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Getting quotas for user 951cabf887f14896b0c4402b686be697 and project c66f397e080f497da06b661ea1a87e03. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:13:22.669419 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:13:22.678472 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:13:22.762604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:22.773578 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-967b6a18-b56b-4339-bd50-90a1df8928d3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.389482 Aug 10 11:13:22.775407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 17/36] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:22 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:22.848284 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4011a9e-3206-400c-a5ce-ff4a75e70090 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.256113 Aug 10 11:13:22.849114 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 20/37] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:13:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 4258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:13:23.086187 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-436d5201-7855-4f65-bdce-00cb7f1eaed3 req-72730dea-e8db-49a0-af9e-86f26ba1332f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2b59a8-db1b-472e-8320-3231f8bd5fb2", "tag": "1ad577b8-a5bc-4866-aa6d-7f89377545ca"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:23.095828 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-5b56ebf4-2b51-448b-aab7-da6f19bf4d77 req-3c0c8e76-ad23-4a78-997b-ed2571131e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265d9c1c-b86e-449c-a651-b8bc81225a88", "tag": "bb7aa967-f1f0-4b38-a15e-3915333bb12b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:23.117618 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-436d5201-7855-4f65-bdce-00cb7f1eaed3 req-72730dea-e8db-49a0-af9e-86f26ba1332f service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.118174 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-436d5201-7855-4f65-bdce-00cb7f1eaed3 req-72730dea-e8db-49a0-af9e-86f26ba1332f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.119180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-436d5201-7855-4f65-bdce-00cb7f1eaed3 req-72730dea-e8db-49a0-af9e-86f26ba1332f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.123369 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5b56ebf4-2b51-448b-aab7-da6f19bf4d77 req-3c0c8e76-ad23-4a78-997b-ed2571131e00 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.123871 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5b56ebf4-2b51-448b-aab7-da6f19bf4d77 req-3c0c8e76-ad23-4a78-997b-ed2571131e00 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.124311 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5b56ebf4-2b51-448b-aab7-da6f19bf4d77 req-3c0c8e76-ad23-4a78-997b-ed2571131e00 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.178677 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-436d5201-7855-4f65-bdce-00cb7f1eaed3 req-72730dea-e8db-49a0-af9e-86f26ba1332f service nova] Creating event network-changed:1ad577b8-a5bc-4866-aa6d-7f89377545ca for instance 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 on hv-cinder-85272 Aug 10 11:13:23.181931 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-436d5201-7855-4f65-bdce-00cb7f1eaed3 req-72730dea-e8db-49a0-af9e-86f26ba1332f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 11:13:23.182361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-436d5201-7855-4f65-bdce-00cb7f1eaed3 req-72730dea-e8db-49a0-af9e-86f26ba1332f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 11:13:23.183735 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7751db7d-4ee1-4b3c-9d11-5aa9457f85f0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.184214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7751db7d-4ee1-4b3c-9d11-5aa9457f85f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.186357 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7751db7d-4ee1-4b3c-9d11-5aa9457f85f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.188253 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7751db7d-4ee1-4b3c-9d11-5aa9457f85f0 None None] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.188582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7751db7d-4ee1-4b3c-9d11-5aa9457f85f0 None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.189015 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7751db7d-4ee1-4b3c-9d11-5aa9457f85f0 None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.199553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-5b56ebf4-2b51-448b-aab7-da6f19bf4d77 req-3c0c8e76-ad23-4a78-997b-ed2571131e00 service nova] Creating event network-changed:bb7aa967-f1f0-4b38-a15e-3915333bb12b for instance 265d9c1c-b86e-449c-a651-b8bc81225a88 on hv-cinder-85272 Aug 10 11:13:23.200170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5b56ebf4-2b51-448b-aab7-da6f19bf4d77 req-3c0c8e76-ad23-4a78-997b-ed2571131e00 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 11:13:23.201870 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5b56ebf4-2b51-448b-aab7-da6f19bf4d77 req-3c0c8e76-ad23-4a78-997b-ed2571131e00 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 11:13:23.204528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072fc58f-3155-423a-8fe6-81176776e30b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.205623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072fc58f-3155-423a-8fe6-81176776e30b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.206245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072fc58f-3155-423a-8fe6-81176776e30b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.210537 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.compute.rpcapi [None req-7751db7d-4ee1-4b3c-9d11-5aa9457f85f0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 11:13:23.211486 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7751db7d-4ee1-4b3c-9d11-5aa9457f85f0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 11:13:23.219608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072fc58f-3155-423a-8fe6-81176776e30b None None] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.220180 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072fc58f-3155-423a-8fe6-81176776e30b None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.220992 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072fc58f-3155-423a-8fe6-81176776e30b None None] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.232550 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.compute.rpcapi [None req-072fc58f-3155-423a-8fe6-81176776e30b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 11:13:23.233830 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072fc58f-3155-423a-8fe6-81176776e30b None None] Releasing lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 11:13:23.242867 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7751db7d-4ee1-4b3c-9d11-5aa9457f85f0 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.463014 Aug 10 11:13:23.246549 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 18/38] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:23.254067 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f6750dac-4077-4cc8-8985-b52304f5dbb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:23.255109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f6750dac-4077-4cc8-8985-b52304f5dbb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:23.265624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-072fc58f-3155-423a-8fe6-81176776e30b None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415040 Aug 10 11:13:23.266321 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 21/39] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:23.272919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:23.273756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:23.298082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=5 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:23.318548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.319491 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.320531 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.321502 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.322227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.322903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.340982 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f6750dac-4077-4cc8-8985-b52304f5dbb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:23.354626 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f6750dac-4077-4cc8-8985-b52304f5dbb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1238 microversion: 2.1 time: 0.106560 Aug 10 11:13:23.355207 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 19/40] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:23 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:23.379026 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:23.379809 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:23.404295 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.404921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.405578 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.405928 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.406369 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.406826 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.430422 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:23.445480 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa51e14a-08d0-453d-aa56-c1c77c585758 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1293 microversion: 2.1 time: 0.177655 Aug 10 11:13:23.447219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 22/41] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:23 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1293 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:23.777556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:23.785371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f35ac00e-aebe-483e-aa49-a8e05a8269d0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.428985 Aug 10 11:13:23.785862 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 20/42] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:23 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:23.795994 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:23.797593 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:23.803708 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.804450 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.804884 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.805577 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:23.806067 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:23.806490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:23.976792 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:23.986262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-60311d33-478f-499f-9082-fa215288e19d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.193778 Aug 10 11:13:23.987637 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 23/43] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:23 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:24.377689 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:24.381362 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:24.387406 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:24.387890 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:24.388342 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:24.389044 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:24.389499 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:24.389976 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:24.464238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:24.467395 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:24.468088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:24.472405 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8b8bfa9a-2c41-485f-9095-ef075024280e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1242 microversion: 2.1 time: 0.098540 Aug 10 11:13:24.473161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 21/44] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:24 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:24.485296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:24.487263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:24.487711 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:24.488436 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:24.490913 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:24.491389 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:24.562092 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:24.570010 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e89db373-a8db-4982-9164-980a4c0468a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1293 microversion: 2.1 time: 0.106553 Aug 10 11:13:24.570608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 24/45] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:24 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:24.807357 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:24.808162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:24.810389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=12 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:24.816956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:24.817407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:24.817814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:24.818516 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:24.818996 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:24.819419 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:24.823216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=73 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:24.974275 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:24.982778 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1de658f0-a461-497f-a68d-4ee18813e3e0 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.180155 Aug 10 11:13:24.983352 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 22/46] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:24 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:25.007179 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:25.008555 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:25.019682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:25.020421 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:25.020878 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:25.021756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:25.024090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:25.024767 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:25.175308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:25.185227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cbfc7201-9587-421d-a7ee-4a536d25a20a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.182047 Aug 10 11:13:25.185987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 25/47] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:25 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:25.494038 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:25.494460 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:25.500439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:25.501029 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:25.501467 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:25.502145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:25.502612 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:25.503037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:25.564287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:25.571545 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-712ad383-95f9-47ac-a9de-b02c8c01e25c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1242 microversion: 2.1 time: 0.082025 Aug 10 11:13:25.572120 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:25 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:25.590988 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:25.591637 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:25.597357 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:25.597842 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:25.598280 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:25.599003 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:25.599464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:25.599891 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:25.672270 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:25.679877 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16ba4ffa-7bc3-4f96-a91d-3ae131bd0acc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1293 microversion: 2.1 time: 0.092735 Aug 10 11:13:25.680444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 26/49] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:25 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:26.004726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:26.005336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:26.011311 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:26.011790 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:26.012222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:26.012905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:26.013359 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:26.013786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:26.148509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:26.158015 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3740ba47-54eb-401f-8b40-e77db18cd01b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.156947 Aug 10 11:13:26.158472 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 24/50] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:25 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:26.207168 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:26.207972 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:26.214038 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:26.214518 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:26.215036 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:26.215931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:26.221065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:26.221619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:26.413305 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:26.424968 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1dc89bce-881b-4857-9014-f73de8045335 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.221574 Aug 10 11:13:26.426275 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 27/51] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:26 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:26.595283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:26.596532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:26.605696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:26.607114 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:26.607732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:26.608604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:26.609205 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:26.609784 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:26.689409 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:26.697185 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-90722914-d556-478a-bcfe-87f3fbe1cee4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1242 microversion: 2.1 time: 0.106619 Aug 10 11:13:26.702548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:26.704158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:26.713465 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:26.714618 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:26.716264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 25/52] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:26 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:26.717907 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:26.718927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:26.719590 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:26.720364 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:26.800495 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:26.811954 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9844dd9f-5a0d-43e2-902f-811a0570291b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1293 microversion: 2.1 time: 0.114417 Aug 10 11:13:26.812624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 28/53] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:26 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:27.179837 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:27.180368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:27.186195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:27.186715 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:27.187151 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:27.187837 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:27.188290 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:27.188712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:27.329511 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:27.337645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d4a4cb5e-6b10-404d-a34a-d9cf85e2438a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.161383 Aug 10 11:13:27.338209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 26/54] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:27 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:27.449238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:27.449847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:27.456496 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:27.456976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:27.457406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:27.458090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:27.458536 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:27.458979 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:27.594505 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:27.601993 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ae5d5840-40fd-446c-a8c1-725d60e296c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.156608 Aug 10 11:13:27.602564 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 29/55] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:27 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:27.718556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:27.719417 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:27.725082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:27.725616 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:27.726039 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:27.726788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:27.727248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:27.727692 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:27.792850 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:27.800734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-387e38a5-866c-4538-a28a-c5ca08fc9306 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1242 microversion: 2.1 time: 0.086211 Aug 10 11:13:27.801469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 27/56] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:27 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:27.832989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:27.833791 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:27.839713 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:27.840188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:27.840619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:27.841300 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:27.841753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:27.842172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:27.860506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:27.907318 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:27.914523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1ef5e28e-4fb2-4394-ba62-56803d4a4149 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1293 microversion: 2.1 time: 0.085331 Aug 10 11:13:27.915158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 30/57] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:27 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:28.357219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:28.358183 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:28.367117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:28.367963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:28.369171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:28.370547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:28.371331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:28.372158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:28.622689 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:28.623304 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:28.630638 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:28.631068 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:28.632152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:28.633372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:28.634737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:28.635563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:28.644616 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:28.653159 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b4fd1957-1c72-40a9-b53b-af8d7c90b056 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.299655 Aug 10 11:13:28.666998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 28/58] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:28 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:28.811211 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-02c4b47f-b27e-4c62-b92f-bf1b98edc960 req-ba080312-e168-48c9-baaa-0897d0754a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8a23cc-cf69-422f-9db5-4853e16830d1", "tag": "98a70eeb-8b46-4c95-bf6f-051b64107251"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:28.822309 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-02c4b47f-b27e-4c62-b92f-bf1b98edc960 req-ba080312-e168-48c9-baaa-0897d0754a7f service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:28.823035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-02c4b47f-b27e-4c62-b92f-bf1b98edc960 req-ba080312-e168-48c9-baaa-0897d0754a7f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:28.823645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-02c4b47f-b27e-4c62-b92f-bf1b98edc960 req-ba080312-e168-48c9-baaa-0897d0754a7f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:28.836185 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-02c4b47f-b27e-4c62-b92f-bf1b98edc960 req-ba080312-e168-48c9-baaa-0897d0754a7f service nova] Creating event network-changed:98a70eeb-8b46-4c95-bf6f-051b64107251 for instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 on hv-cinder-85272 Aug 10 11:13:28.841594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-02c4b47f-b27e-4c62-b92f-bf1b98edc960 req-ba080312-e168-48c9-baaa-0897d0754a7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034057 Aug 10 11:13:28.842205 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 29/59] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:28.848876 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:28.849874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:28.859827 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:28.860321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:28.861032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:28.861925 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:28.862545 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:28.863192 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:28.987562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:28.996199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dd29e446-d68c-4a6d-9720-2467ad591664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1290 microversion: 2.1 time: 0.152585 Aug 10 11:13:28.997666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 30/60] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:28 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1290 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:29.019109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:29.020013 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:29.026643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:29.027400 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:29.028014 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:29.028906 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:29.029523 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:29.030114 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:29.063329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:29.082950 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dc183e3d-cd2a-49a6-8b8b-879bb4759cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.464603 Aug 10 11:13:29.083748 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 31/61] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:28 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:29.148687 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:29.162359 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e8b6b187-4be8-4602-9bc9-bc777ddcdb15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1299 microversion: 2.1 time: 0.150155 Aug 10 11:13:29.162977 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 31/62] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:29 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:29.691045 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:29.692361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:29.706357 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:29.707967 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:29.709716 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:29.710535 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:29.716006 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:29.716639 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:29.882825 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:29.891914 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5bd3ea4d-7f32-46d5-a1a4-18385639c514 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.221183 Aug 10 11:13:29.893183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 32/63] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:29 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:30.023068 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:30.023966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:30.030386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:30.031252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:30.032002 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:30.032827 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:30.033489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:30.033980 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:30.111030 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:30.112584 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:30.126094 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:30.126838 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:30.128061 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:30.130259 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:30.131646 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:30.132309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:30.133124 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:30.143494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e301e823-393b-45e7-9b28-14590a0e9356 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1296 microversion: 2.1 time: 0.124482 Aug 10 11:13:30.144190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 32/64] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:30 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1296 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:30.185845 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:30.186524 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:30.192273 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:30.192951 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:30.193390 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:30.194100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:30.194550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:30.194994 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:30.520431 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:30.527918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-576f3b36-930e-4cef-ba0e-5622a14cdc1d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.420679 Aug 10 11:13:30.528488 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 33/65] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:30 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:30.545224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:30.552593 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0468eae0-308b-426a-842c-1131d7207703 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.372036 Aug 10 11:13:30.553155 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 33/66] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:30 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:30.914214 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:30.914893 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:30.921328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:30.921812 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:30.922252 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:30.922981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:30.923438 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:30.923864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:31.046207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:31.053572 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f322929-c70f-499f-94e5-b3d4bc2a358e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.143207 Aug 10 11:13:31.054389 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 34/67] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:30 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:31.167567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:31.168180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:31.177712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:31.178212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:31.178692 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:31.179682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:31.180140 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:31.180570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:31.240650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:31.248019 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4f0ecdac-6409-4ad8-b09a-1bdb8364efc3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1296 microversion: 2.1 time: 0.084917 Aug 10 11:13:31.248594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 34/68] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:31 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:31.548254 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:31.548863 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:31.555013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:31.555494 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:31.555987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:31.556698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:31.557152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:31.557574 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:31.573488 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:31.574187 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:31.579997 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:31.580469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:31.580893 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:31.581569 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:31.582010 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:31.582424 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:31.746996 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:31.755123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4c406718-a264-4376-b6c2-db82062e8ac2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.210569 Aug 10 11:13:31.756926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 35/69] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:31 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:31.760453 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:31.786110 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cbc04d13-ad2b-45e1-8457-a22f91a73cad tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.216796 Aug 10 11:13:31.786717 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 35/70] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:31 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:32.075272 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:32.075888 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:32.081701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:32.082179 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:32.082633 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:32.083320 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:32.083779 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:32.084200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:32.213795 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:32.221200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-86d0ef51-5180-4401-9909-7aabf2514d4f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.149877 Aug 10 11:13:32.221758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 36/71] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:32 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:32.268453 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:32.269141 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:32.275787 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:32.276304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:32.276737 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:32.277455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:32.277903 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:32.278322 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:32.339892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:32.347931 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-16b669f3-d5f2-406a-8c8f-3a77769d11e2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1296 microversion: 2.1 time: 0.083175 Aug 10 11:13:32.348867 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 36/72] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:32 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:32.776435 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:32.777031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:32.778933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=20 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:32.784156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:32.784634 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:32.785063 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:32.785744 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:32.786195 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:32.786635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:32.807998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:32.808598 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:32.814779 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:32.815267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:32.815700 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:32.816410 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:32.816851 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:32.817435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:32.969509 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:32.976958 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8ffb0f5c-3166-46f4-8d00-6ceb3d22a93e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.204394 Aug 10 11:13:32.977659 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 37/73] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:32 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:32.989833 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:32.997767 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-19e2fb7c-b8a1-45b6-b5cc-9bc54803e9c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.194387 Aug 10 11:13:32.998329 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 37/74] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:32 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:33.241905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:33.242550 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:33.245005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:33.250199 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:33.250708 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:33.251144 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:33.251830 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:33.252282 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:33.252708 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:33.372628 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:33.373232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:33.375195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:33.375841 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=14 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:33.381236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:33.381665 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:33.382145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:33.382594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:33.383311 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:33.383754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:33.384169 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:33.388661 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-26cfebe4-554e-45dd-810c-289c7e99e84a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.150530 Aug 10 11:13:33.389230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 38/75] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:33 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:33.452643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:33.460066 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0afe94f2-974a-4a71-91c1-9946b5dbaf39 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1296 microversion: 2.1 time: 0.091955 Aug 10 11:13:33.460632 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 38/76] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:33 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:33.997544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:33.998433 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:34.006086 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:34.006590 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:34.007186 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:34.008070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:34.009389 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:34.009968 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:34.018957 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:34.019942 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:34.029415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:34.030837 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:34.032251 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:34.033212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:34.035096 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:34.036058 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:34.054606 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:34.401508 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:34.411247 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29f7f40a-7922-4071-a189-02a593398f1e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.417789 Aug 10 11:13:34.411829 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 39/77] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:33 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:34.417307 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:34.418263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:34.425204 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:34.425852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:34.426521 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:34.427294 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:34.430409 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:34.431416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:34.464979 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:34.474380 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5969bd19-3008-44bc-84a7-3981431ffbd3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.459567 Aug 10 11:13:34.478165 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 39/78] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:34 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:34.485174 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:34.486173 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:34.495100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:34.495903 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:34.496488 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:34.497358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:34.498440 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:34.498931 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:34.646995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:34.662915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8844d0c1-67fa-46aa-9b01-1ffb252b05a4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1296 microversion: 2.1 time: 0.183387 Aug 10 11:13:34.663500 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 40/79] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:34 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:34.812480 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:34.825822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-463358f6-2a0f-4667-8364-12362459c592 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.412771 Aug 10 11:13:34.827536 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 40/80] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:34 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:35.115815 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-daa60da5-8c2d-4bf3-a620-a3f952a40d73 req-ccd4fe25-af2c-4bfe-90aa-2a027d9245f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416de879-4113-49f9-b2a9-04398bd17e4a", "tag": "9b7676b1-1e6e-4948-8893-e526c58468e0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:35.126480 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-daa60da5-8c2d-4bf3-a620-a3f952a40d73 req-ccd4fe25-af2c-4bfe-90aa-2a027d9245f1 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:35.126978 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-daa60da5-8c2d-4bf3-a620-a3f952a40d73 req-ccd4fe25-af2c-4bfe-90aa-2a027d9245f1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:35.130182 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-daa60da5-8c2d-4bf3-a620-a3f952a40d73 req-ccd4fe25-af2c-4bfe-90aa-2a027d9245f1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:35.140253 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-daa60da5-8c2d-4bf3-a620-a3f952a40d73 req-ccd4fe25-af2c-4bfe-90aa-2a027d9245f1 service nova] Creating event network-changed:9b7676b1-1e6e-4948-8893-e526c58468e0 for instance 416de879-4113-49f9-b2a9-04398bd17e4a on hv-cinder-85272 Aug 10 11:13:35.145434 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-daa60da5-8c2d-4bf3-a620-a3f952a40d73 req-ccd4fe25-af2c-4bfe-90aa-2a027d9245f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033261 Aug 10 11:13:35.146037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 41/81] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:35.432459 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:35.433301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:35.439434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:35.439918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:35.440348 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:35.441044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:35.441493 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:35.441918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:35.497249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:35.497916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:35.505345 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:35.505841 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:35.506275 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:35.507011 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:35.507460 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:35.507879 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:35.628163 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:35.637684 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-37787d42-4463-4224-8548-530adb3f5f29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.209311 Aug 10 11:13:35.638258 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 41/82] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:35 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:35.672324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:35.679908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d831474b-7437-4b5c-9d82-ec53d2e94882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.187051 Aug 10 11:13:35.681028 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 42/83] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:35 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:35.684718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:35.685285 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:35.691225 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:35.691714 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:35.692149 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:35.692844 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:35.693303 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:35.693731 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:35.822195 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:35.829584 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f01994b8-4c43-46ed-87bf-d205ed65289e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.149301 Aug 10 11:13:35.830154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 42/84] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:35 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:35.847775 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:35.848464 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:35.854511 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:35.855113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:35.855623 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:35.856373 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:35.856831 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:35.857255 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:35.990063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:35.997436 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-48063f5a-ee88-4513-a319-2737c4a1b9fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.153584 Aug 10 11:13:35.997995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 43/85] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:35 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:36.658709 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:36.659318 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:36.665975 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:36.666461 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:36.666950 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:36.667638 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:36.668092 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:36.668520 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:36.700590 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:36.701196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:36.707170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:36.707645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:36.708070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:36.708754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:36.709203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:36.709621 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:37.020404 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:37.027959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-79b06dce-ad28-4b4f-8b4f-956af5c75a7d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.373151 Aug 10 11:13:37.028620 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 43/86] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:36 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:37.033025 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:37.033696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:37.039481 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:37.040620 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:37.041229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:37.041921 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:37.042372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:37.042867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:37.046992 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:37.054799 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6e88bd64-ad1e-46da-b097-8e35cca5be65 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.357612 Aug 10 11:13:37.055301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 44/87] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:36 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:37.060435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:37.061248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:37.067142 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:37.067774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:37.068393 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:37.069192 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:37.069651 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:37.070078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:37.234562 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:37.242175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-49973f9c-cff4-4ff4-bf29-bdc50f727453 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.212520 Aug 10 11:13:37.242765 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 44/88] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:37 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:37.247885 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:37.255151 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-93d581cc-7663-4150-b7d1-74e0eb4f4c1f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.198226 Aug 10 11:13:37.255699 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 45/89] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:37 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:38.047992 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:38.048718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:38.054885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:38.055378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:38.056338 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:38.057032 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:38.057485 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:38.057914 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:38.078002 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:38.078707 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:38.084559 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:38.085039 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:38.085477 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:38.086187 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:38.086660 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:38.087137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:38.251034 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:38.254163 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:38.259383 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e4363941-3288-42fc-9cd7-8001999eb758 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.214610 Aug 10 11:13:38.259954 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 45/90] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:38 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:38.262227 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5093b987-3458-4afc-856e-4d266f424c4d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.189273 Aug 10 11:13:38.262951 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 46/91] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:38 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:38.264601 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:38.265215 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:38.271984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:38.272592 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:38.273030 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:38.273720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:38.274207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:38.274740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:38.279805 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:38.280406 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:38.286055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:38.286525 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:38.287006 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:38.287686 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:38.288134 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:38.288549 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:38.485562 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:38.488296 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:38.494247 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e7d0488d-3a9a-44ef-82d6-4e48738af8ac tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.233099 Aug 10 11:13:38.495319 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 46/92] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:38 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:38.497173 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bd1fed00-255a-4ac2-b4d3-c909ee2daa51 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.220844 Aug 10 11:13:38.497737 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 47/93] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:38 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:39.020027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-bec4e226-d8eb-41ca-9ae2-b127b96d54da req-e6d70a18-8e09-4759-93d1-6eeaa3da1476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d74ab5-9978-4af6-9fff-34b86d739057", "tag": "90757e23-502d-4a8b-bc8b-3a17f062540c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:39.030624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bec4e226-d8eb-41ca-9ae2-b127b96d54da req-e6d70a18-8e09-4759-93d1-6eeaa3da1476 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:39.031336 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bec4e226-d8eb-41ca-9ae2-b127b96d54da req-e6d70a18-8e09-4759-93d1-6eeaa3da1476 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:39.031951 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bec4e226-d8eb-41ca-9ae2-b127b96d54da req-e6d70a18-8e09-4759-93d1-6eeaa3da1476 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:39.037101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:39.045728 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-bec4e226-d8eb-41ca-9ae2-b127b96d54da req-e6d70a18-8e09-4759-93d1-6eeaa3da1476 service nova] Creating event network-changed:90757e23-502d-4a8b-bc8b-3a17f062540c for instance b5d74ab5-9978-4af6-9fff-34b86d739057 on hv-cinder-85272 Aug 10 11:13:39.051200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-bec4e226-d8eb-41ca-9ae2-b127b96d54da req-e6d70a18-8e09-4759-93d1-6eeaa3da1476 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034762 Aug 10 11:13:39.052236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 47/94] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:39.280024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:39.280633 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:39.283036 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:39.283738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:39.286857 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:39.287391 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:39.287770 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:39.288466 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:39.288921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:39.289346 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:39.289725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:39.290220 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:39.290653 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:39.291334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:39.291785 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:39.292204 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:39.481014 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:39.487961 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:39.488431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b8c4a47b-8f2a-4557-8cff-fa55c6b20bc5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.212399 Aug 10 11:13:39.489003 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 48/95] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:39 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:39.496095 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3345efd8-ee82-41c3-a6cf-a7eefd456350 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.217226 Aug 10 11:13:39.496740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 48/96] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:39 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:39.515009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:39.515620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:39.516989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:39.517592 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:39.521436 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:39.521918 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:39.522349 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:39.523062 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:39.523255 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:39.523509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:39.523732 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:39.523934 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:39.524188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:39.524891 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:39.525339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:39.525761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:39.715769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:39.719759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:39.723257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b41db753-4f1d-4726-abbe-36fd440023ce tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.211936 Aug 10 11:13:39.723828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 49/97] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:39 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:39.727089 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1bd0c4a1-b55c-41d5-b7df-5aa5099611b1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.213710 Aug 10 11:13:39.727679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 49/98] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:39 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:40.509764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:40.510372 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:40.516414 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:40.516536 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:40.516925 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:40.517309 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:40.517585 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:40.517998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:40.518447 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:40.518894 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:40.523751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:40.524232 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:40.525321 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:40.526009 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:40.526459 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:40.526942 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:40.707186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:40.711123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:40.715221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9a899721-b9f5-468c-b134-089936f1ffee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.209823 Aug 10 11:13:40.715794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 50/99] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:40 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:40.719053 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ad8edd8c-8f6a-4470-af7c-25e2589e96c9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.206361 Aug 10 11:13:40.719609 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 50/100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:40 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:40.744265 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:40.744864 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:40.747485 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:40.748200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:40.750684 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:40.751163 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:40.751650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:40.752330 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:40.752780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:40.753198 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:40.754264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:40.754892 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:40.755336 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:40.756034 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:40.756507 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:40.756921 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:40.942963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:40.947437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:40.950997 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4cf4b713-ba1b-4fd2-b54b-5c17a435918b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.210909 Aug 10 11:13:40.951566 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 51/101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:40 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:40.954854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dcb8d689-ec27-404f-9bba-dd6fe41b7344 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.211643 Aug 10 11:13:40.955363 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 51/102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:40 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:41.735340 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:41.735944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:41.739377 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:41.740016 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:41.741876 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:41.742345 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:41.742808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:41.743489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:41.743934 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:41.744350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:41.745902 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:41.746386 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:41.746854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:41.747535 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:41.747989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:41.748409 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:41.936275 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:41.939307 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:41.945309 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-10f96f92-9482-4155-8ac5-ccf03a1f4d8b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.213802 Aug 10 11:13:41.945886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 52/103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:41 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:41.946758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-485d3f45-5ff7-483b-890d-1cc39cf21edb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.211110 Aug 10 11:13:41.947329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 52/104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:41 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:41.971499 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:41.972109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:41.974415 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:41.975050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:41.978175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:41.978689 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:41.979131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:41.979822 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:41.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:41.980698 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:41.980853 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:41.981334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:41.981767 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:41.982450 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:41.982933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:41.983356 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:42.170703 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:42.173716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:42.178090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-958317d6-0fbb-4795-bc97-812c0fa0febd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.207284 Aug 10 11:13:42.178709 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 53/105] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:41 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:42.182074 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1928a679-8757-4620-8366-eba0171c317f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.214351 Aug 10 11:13:42.182730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 53/106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:41 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:42.965492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:42.966093 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:42.967464 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:42.968068 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:42.972238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:42.972718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:42.973156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:42.973840 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:42.973945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:42.974310 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:42.974409 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:42.974769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:42.974970 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:42.975445 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:42.975889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:42.976343 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:43.170246 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:43.172644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:43.180370 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-27332c62-7f6d-4c15-b1ac-f023406d635e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.216674 Aug 10 11:13:43.180959 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 54/107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:42 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:43.181981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a9380b07-ba65-4cc6-8c6d-86c95cd47a0b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.220391 Aug 10 11:13:43.182739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 54/108] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:42 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:43.199901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:43.200506 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:43.202535 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:43.203190 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:43.206477 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:43.207000 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:43.207430 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:43.208120 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:43.208573 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:43.208952 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:43.209054 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:43.209432 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:43.209864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:43.210552 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:43.211033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:43.211457 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:43.400644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:43.407468 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:43.407987 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-72e3c15c-d5f3-4f53-8d5d-6dd1655dd7fb tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.212540 Aug 10 11:13:43.408559 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 55/109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:43 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:43.415123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a5a7e0d5-196a-4a19-8bbe-e05283680c7b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.216293 Aug 10 11:13:43.415679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 55/110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:43 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:44.202764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:44.203374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:44.203782 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:44.204416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:44.209385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:44.209863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:44.210164 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:44.210357 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:44.210670 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:44.211071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:44.211161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:44.211522 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:44.211757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:44.211943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:44.212200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:44.212643 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:44.406076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:44.408599 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:44.408945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:44.421156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a422671e-8f68-4729-8eeb-516b5d9c185a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.221045 Aug 10 11:13:44.421543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d5ee2634-696d-4697-a120-1952410319dd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.222404 Aug 10 11:13:44.427316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 56/111] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:44 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:44.427316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:44.427688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 56/112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:44 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:44.427760 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:44.434919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:44.435406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:44.435833 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:44.436559 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:44.437033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:44.437447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:44.443107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:44.443819 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:44.451100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:44.451667 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:44.452200 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:44.453097 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:44.453618 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:44.454108 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:44.645200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:44.649241 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:44.653241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f13f575-7e38-4bee-8569-1649498204d9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.229877 Aug 10 11:13:44.654018 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 57/113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:44 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:44.657501 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a88787d3-e26f-4232-be7f-615bb70501fe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.218667 Aug 10 11:13:44.658060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 57/114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:44 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:45.444052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:45.444659 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:45.445088 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:45.445800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:45.451983 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:45.452541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:45.453037 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:45.453162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:45.453546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:45.453977 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:45.454691 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:45.455318 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:45.455438 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:45.455761 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:45.456028 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:45.456603 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:45.669803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:45.675872 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:45.685884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6dd479d3-4086-4335-b256-0f7166e79d59 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.244877 Aug 10 11:13:45.686056 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b9554aae-2af8-4ea7-a77d-18ecbf0bab15 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.245965 Aug 10 11:13:45.686550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 58/115] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:45 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:45.691398 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:45.692324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:45.699036 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:45.699707 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:45.700139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:45.700823 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:45.700963 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 58/116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:45 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:45.701532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:45.702116 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:45.707166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:45.708241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:45.715536 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:45.716647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:45.717219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:45.718063 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:45.718506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:45.719112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:45.919184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:45.930945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:45.932842 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ede6329d-3c02-4b8d-830a-8c28454d788e tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.244611 Aug 10 11:13:45.933858 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 59/117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:45 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:45.938693 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-545eb74f-2f1f-44d8-bba3-870abc9c45ab tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.236126 Aug 10 11:13:45.939264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 59/118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:45 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:46.706963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:46.707900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:46.708359 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:46.708506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:46.714749 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:46.715409 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:46.716012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:46.716747 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:46.717017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:46.717753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:46.718309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:46.718851 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:46.722234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:46.723191 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:46.723803 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:46.724330 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:46.959714 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:46.960384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:46.968556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c9a6ca94-a63a-432c-8392-cc5b8d4010dc tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.265713 Aug 10 11:13:46.969748 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 60/119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:46 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:46.973920 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5e074ab6-b5d9-4c8d-9e59-b029e7d020b3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.269908 Aug 10 11:13:46.974552 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:46.974682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 60/120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:46 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:46.975199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:46.981332 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:46.981968 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:46.982556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:46.983287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:46.983737 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:46.984190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:46.991418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:46.992108 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:47.000949 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:47.001614 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:47.002120 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:47.003929 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:47.004698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:47.005200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:47.242216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:47.247495 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:47.256432 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-021897fd-5fff-4b02-ad08-6551604cf19b tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.285368 Aug 10 11:13:47.260601 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dabbfec3-0839-4276-a73c-163572f98390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.284630 Aug 10 11:13:47.263332 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 61/121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:46 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:47.273492 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 61/122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:46 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:47.990166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:47.991789 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:48.000536 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:48.001402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:48.001999 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:48.002901 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:48.003380 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:48.004056 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:48.004474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:48.005092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:48.024242 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:48.025926 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:48.027746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:48.029061 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:48.030277 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:48.031102 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:48.311400 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:48.319189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe0baf84-6823-4ce9-aad6-a431f4dd9a89 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.333716 Aug 10 11:13:48.327806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:48.332206 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 62/123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:47 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:48.341398 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0fb23aa1-e9fc-44a0-95f8-a2f3f5e73a34 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.342048 Aug 10 11:13:48.342697 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 62/124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:47 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:48.350547 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:48.350707 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:48.351285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:48.352523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:48.363018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:48.363380 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:48.363815 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:48.366068 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:48.366731 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:48.367898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:48.369586 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:48.370539 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:48.371606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:48.375474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:48.376340 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:48.376787 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:48.688874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:48.704761 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bb15848f-c55f-422b-84e2-c931c014c770 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.360538 Aug 10 11:13:48.707481 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 63/125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:48 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:48.755465 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:48.767355 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-31de5f7c-0038-415b-8bd6-049045c7a81f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.433786 Aug 10 11:13:48.767937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 63/126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:48 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:49.151154 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-d24fd804-bdfc-4992-8f6a-87c818420f66 req-05993a89-bf4e-42c3-b68d-7efacf87841a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265d9c1c-b86e-449c-a651-b8bc81225a88", "name": "network-vif-plugged", "status": "completed", "tag": "bb7aa967-f1f0-4b38-a15e-3915333bb12b"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:49.162436 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d24fd804-bdfc-4992-8f6a-87c818420f66 req-05993a89-bf4e-42c3-b68d-7efacf87841a service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:49.162941 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d24fd804-bdfc-4992-8f6a-87c818420f66 req-05993a89-bf4e-42c3-b68d-7efacf87841a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:49.163417 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d24fd804-bdfc-4992-8f6a-87c818420f66 req-05993a89-bf4e-42c3-b68d-7efacf87841a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:49.176375 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-d24fd804-bdfc-4992-8f6a-87c818420f66 req-05993a89-bf4e-42c3-b68d-7efacf87841a service nova] Creating event network-vif-plugged:bb7aa967-f1f0-4b38-a15e-3915333bb12b for instance 265d9c1c-b86e-449c-a651-b8bc81225a88 on hv-cinder-85272 Aug 10 11:13:49.181678 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-d24fd804-bdfc-4992-8f6a-87c818420f66 req-05993a89-bf4e-42c3-b68d-7efacf87841a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180344 Aug 10 11:13:49.190071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 64/127] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:13:49.340899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:49.342862 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:49.349909 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:49.350693 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:49.351370 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:49.352623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:49.353534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:49.354028 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:49.368645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:49.369648 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:49.376682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:49.377548 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:49.378195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:49.378942 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:49.380041 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:49.380784 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:49.381515 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:49.569054 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:49.579080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce60bcb4-2108-4d09-b505-c3d9db76f382 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.243095 Aug 10 11:13:49.581928 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:49.591630 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a77ad4f5-d4b7-42a7-ae57-2d70b4ac6492 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.230387 Aug 10 11:13:49.592421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 65/128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:49 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:49.593136 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 64/129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:49 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:49.727856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:49.728468 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:49.736079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:49.736570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:49.737006 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:49.737708 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:49.740773 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:49.741418 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:49.790227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:49.790982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:49.798422 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:49.799198 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:49.800152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:49.801938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:49.802559 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:49.803156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:50.022930 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:50.036235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1ce6950b-a03f-4e83-a36e-d0db8320e227 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.309129 Aug 10 11:13:50.036976 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 66/130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:49 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:50.068758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:50.077871 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3f20be6-e5c1-42cc-a1ee-73f45542b374 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.292223 Aug 10 11:13:50.081519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 65/131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:49 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:50.600978 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:50.601647 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:50.608495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:50.609248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:50.610117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:50.611115 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:50.611774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:50.612423 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:50.614872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:50.615538 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:50.625071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:50.625894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:50.627063 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:50.629384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:50.630779 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:50.631674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:51.242482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:51.256903 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:51.265985 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9e4913a1-0c91-4795-8761-24439ec028b2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.669674 Aug 10 11:13:51.268530 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 67/132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:50 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:51.275116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e1c504bb-7c3e-4efb-8fb7-53baca95e1f9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.662120 Aug 10 11:13:51.278339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:51.283805 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:51.292124 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 66/133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:50 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:51.294125 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:51.295531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:51.297392 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:51.298315 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:51.303607 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:51.303949 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:51.304402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:51.306852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:51.321015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:51.323055 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:51.324446 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:51.325470 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:51.326923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:51.327570 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:51.770279 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:51.770926 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:51.779220 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82ac514f-8677-4da2-a7fa-9982d1448510 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.485929 Aug 10 11:13:51.779803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 67/134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:51 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:51.781939 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-53bf3eb1-3427-4d5a-83b6-be21423ccfe5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.510325 Aug 10 11:13:51.783221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 68/135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:51 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:52.290886 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:52.291499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:52.302327 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:52.302541 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:52.302841 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:52.303266 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:52.303408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:52.304835 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:52.305890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:52.307059 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:52.311369 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:52.311859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:52.318155 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:52.319203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:52.319823 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:52.320402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:52.597415 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:52.609455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85c46029-729e-463c-9f08-034b2847c125 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.324354 Aug 10 11:13:52.616995 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 68/136] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:52 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:52.726149 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:52.728442 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-16dcdb4b-fb21-49fa-a783-27ff0194b754 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.429577 Aug 10 11:13:52.729017 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 69/137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:52 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:52.799878 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:52.800483 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:52.815900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:52.817431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:52.823495 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:52.823995 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:52.824430 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:52.826877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:52.827349 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:52.827841 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:52.828470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:52.828900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:52.829680 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:52.830280 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:52.830959 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:52.835868 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:53.356207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:53.369230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8d64b761-a9c8-4216-ae3e-ce07da20963f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.572501 Aug 10 11:13:53.370294 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 69/138] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:52 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:53.378210 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-afe3a3e8-198d-434a-a435-e60fd87714ad req-d5fa7e6a-b351-49f5-8fc8-fa26242df72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8a23cc-cf69-422f-9db5-4853e16830d1", "name": "network-vif-plugged", "status": "completed", "tag": "98a70eeb-8b46-4c95-bf6f-051b64107251"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:53.395007 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=96 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:53.406911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:53.417250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-afe3a3e8-198d-434a-a435-e60fd87714ad req-d5fa7e6a-b351-49f5-8fc8-fa26242df72a service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:53.417830 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-afe3a3e8-198d-434a-a435-e60fd87714ad req-d5fa7e6a-b351-49f5-8fc8-fa26242df72a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:53.418188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-afe3a3e8-198d-434a-a435-e60fd87714ad req-d5fa7e6a-b351-49f5-8fc8-fa26242df72a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:53.419251 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e444cda7-f457-4455-a48f-2028b479692d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.607933 Aug 10 11:13:53.422396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 70/139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:52 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:53.441924 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-afe3a3e8-198d-434a-a435-e60fd87714ad req-d5fa7e6a-b351-49f5-8fc8-fa26242df72a service nova] Creating event network-vif-plugged:98a70eeb-8b46-4c95-bf6f-051b64107251 for instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 on hv-cinder-85272 Aug 10 11:13:53.460566 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-afe3a3e8-198d-434a-a435-e60fd87714ad req-d5fa7e6a-b351-49f5-8fc8-fa26242df72a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088810 Aug 10 11:13:53.461469 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 70/140] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:53.640708 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:53.642003 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:53.650523 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:53.651068 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:53.651751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:53.652687 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:53.655033 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:53.656037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:53.750674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:53.751519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:53.761968 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:53.764870 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:53.765323 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:53.766170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:53.766655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:53.767081 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:54.077923 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:54.087929 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dd0bc744-6596-444e-a160-bd032bc2d9f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.453727 Aug 10 11:13:54.105770 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 71/141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:53 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:54.181226 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:54.197281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-06f87f90-4003-4ae4-b1eb-dbb9ab0663c3 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.451428 Aug 10 11:13:54.207700 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 71/142] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:53 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:54.396829 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:54.398239 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:54.401723 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:54.408007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:54.409539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:54.410247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:54.411201 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:54.412285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:54.412891 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:54.443173 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:54.444182 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:54.452526 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:54.453413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:54.454057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:54.455003 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:54.455790 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:54.456521 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:54.692099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:54.693160 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:54.700982 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e766e387-cf04-48c3-bd95-ce25eb929d76 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.310385 Aug 10 11:13:54.702060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 72/143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:54 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:54.706016 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4226b4a4-c4a9-40fc-8af2-01a9278fb2e7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.267609 Aug 10 11:13:54.711327 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 72/144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:54 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:55.113854 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:55.114489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:55.122945 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:55.123517 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:55.124082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:55.124932 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:55.125394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:55.126070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:55.231192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:55.231997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:55.240548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:55.241407 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:55.242052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:55.243363 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:55.244018 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:55.245740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:55.285513 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:55.293006 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-987d2a5f-9f33-4d3a-aab1-1519a1346b41 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.184215 Aug 10 11:13:55.300238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 73/145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:55 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:55.433740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:55.447279 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-71c7757a-2614-474e-9bde-13710d67d1c6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.224667 Aug 10 11:13:55.458245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 73/146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:55 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:55.477751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-915891e9-a63b-48d2-a56f-9394e100b895 req-fc6c3920-b28c-48e6-b166-daf97ddf31dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2b59a8-db1b-472e-8320-3231f8bd5fb2", "name": "network-vif-plugged", "status": "completed", "tag": "1ad577b8-a5bc-4866-aa6d-7f89377545ca"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:55.498249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-915891e9-a63b-48d2-a56f-9394e100b895 req-fc6c3920-b28c-48e6-b166-daf97ddf31dd service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:55.502164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-915891e9-a63b-48d2-a56f-9394e100b895 req-fc6c3920-b28c-48e6-b166-daf97ddf31dd service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:55.502844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-915891e9-a63b-48d2-a56f-9394e100b895 req-fc6c3920-b28c-48e6-b166-daf97ddf31dd service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:55.508792 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:13:55.520943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-915891e9-a63b-48d2-a56f-9394e100b895 req-fc6c3920-b28c-48e6-b166-daf97ddf31dd service nova] Creating event network-vif-plugged:1ad577b8-a5bc-4866-aa6d-7f89377545ca for instance 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 on hv-cinder-85272 Aug 10 11:13:55.527820 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-915891e9-a63b-48d2-a56f-9394e100b895 req-fc6c3920-b28c-48e6-b166-daf97ddf31dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054024 Aug 10 11:13:55.528502 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 74/147] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:55.732294 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:55.732868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:55.738619 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:55.738849 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:55.754428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:55.754962 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:55.755404 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:55.756118 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:55.756575 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:55.761284 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:55.766136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:55.767435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:55.768079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:55.778238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:55.778743 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:55.779183 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:56.017715 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:56.031595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9739b29e-165e-4883-9fe6-f7fec0cc994f tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.313576 Aug 10 11:13:56.032195 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 74/148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:55 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:56.106068 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:56.123284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0d4e12d4-eade-49a5-b7e7-dcab05345317 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.394782 Aug 10 11:13:56.126182 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 75/149] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:55 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:56.320772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:56.321397 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:56.328063 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:56.328835 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:56.329605 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:56.330452 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:56.331072 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:56.331642 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:56.481469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:56.483607 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:56.491485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:56.492394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:56.493045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:56.493778 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:56.494428 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:56.495333 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:56.511353 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:56.521925 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1fa874e-52d6-43e0-8d7c-b518f780617d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.205128 Aug 10 11:13:56.522895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 75/150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:56 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:56.694408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:56.702292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f6350476-02f1-4971-be58-55d706664ced tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.232190 Aug 10 11:13:56.702894 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 76/151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:56 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:57.055821 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:57.056614 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:57.067319 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:57.067843 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:57.068278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:57.069152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:57.069822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:57.070451 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:57.149003 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:57.149831 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:57.156796 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:57.157823 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:57.158444 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:57.159649 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:57.160248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:57.160862 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:57.342875 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:57.353681 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be262077-fef3-455c-99b4-b1608bc92681 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.304520 Aug 10 11:13:57.355258 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 76/152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:57 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:57.400429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:57.408946 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cfecc50c-4a20-4f2f-b830-a2cd88df248b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.264747 Aug 10 11:13:57.415646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 77/153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:57 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:57.546021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:57.547089 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:57.554351 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:57.555508 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:57.556225 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:57.557380 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:57.559022 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:57.559678 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:57.700574 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:57.708524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82308b24-eab6-4734-a0ab-3843b84c6109 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.167077 Aug 10 11:13:57.709089 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 77/154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:57 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:57.726371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:57.727028 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:57.733537 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:57.734161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:57.734866 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:57.735928 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:57.736623 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:57.737046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:57.911097 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:57.919592 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-354b2e45-41ce-49c1-b49b-c4ebd1fcf5ab tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.197126 Aug 10 11:13:57.927358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 78/155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:57 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:58.378472 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:58.379408 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:58.387444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:58.387924 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:58.388466 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:58.389300 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:58.389751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:58.390175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:58.436312 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:58.437070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:58.443838 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:58.444202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:58.444637 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:58.445350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:58.445806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:58.446695 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:58.609566 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:58.622919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f77acc76-0eb9-4721-86cc-c533b177d19a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.249409 Aug 10 11:13:58.623671 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 78/156] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:58 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:58.727548 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:58.733388 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:58.734490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:58.737460 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d8d83a35-21bd-495c-a152-8326bbd74285 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.305602 Aug 10 11:13:58.738483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 79/157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:58 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:58.747879 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:58.748822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:58.749351 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:58.750158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:58.750740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:58.751472 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:58.946169 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:58.948266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:58.960789 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:58.961297 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:58.964594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:58.965603 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:58.966069 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:58.968581 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.081381 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:59.102171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6e1b89d4-7330-4912-a42b-5eed8dd86ef1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.376240 Aug 10 11:13:59.116240 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 79/158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:58 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:13:59.259045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:59.281982 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7be1312a-758e-48d4-b08d-569e2c4d16a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.340412 Aug 10 11:13:59.295077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 80/159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:58 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:13:59.336990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-975260e5-c1e3-4c91-afde-8626d16c3756 req-c0700a3c-389f-4697-a118-a1b92cb7d8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d74ab5-9978-4af6-9fff-34b86d739057", "name": "network-vif-plugged", "status": "completed", "tag": "90757e23-502d-4a8b-bc8b-3a17f062540c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:13:59.358787 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-975260e5-c1e3-4c91-afde-8626d16c3756 req-c0700a3c-389f-4697-a118-a1b92cb7d8bf service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:59.359272 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-975260e5-c1e3-4c91-afde-8626d16c3756 req-c0700a3c-389f-4697-a118-a1b92cb7d8bf service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:59.359863 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-975260e5-c1e3-4c91-afde-8626d16c3756 req-c0700a3c-389f-4697-a118-a1b92cb7d8bf service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.384721 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-975260e5-c1e3-4c91-afde-8626d16c3756 req-c0700a3c-389f-4697-a118-a1b92cb7d8bf service nova] Creating event network-vif-plugged:90757e23-502d-4a8b-bc8b-3a17f062540c for instance b5d74ab5-9978-4af6-9fff-34b86d739057 on hv-cinder-85272 Aug 10 11:13:59.395826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-975260e5-c1e3-4c91-afde-8626d16c3756 req-c0700a3c-389f-4697-a118-a1b92cb7d8bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062260 Aug 10 11:13:59.396439 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 80/160] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:13:59.648125 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:59.649338 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:59.659323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:59.659323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:59.659323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.660180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:59.660693 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:59.661281 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.763424 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:13:59.764433 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:13:59.779966 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:59.786033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:59.786500 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.788436 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:59.790090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:59.790652 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.867398 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:13:59.882140 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-067d1d81-012d-449d-a26f-4868e53ffcde tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.239178 Aug 10 11:13:59.883952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 81/161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:59 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:00.104110 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:00.113374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e41d51f2-9d9e-43dc-b113-6717ea87669c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.357764 Aug 10 11:14:00.127156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 81/162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:13:59 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:00.133875 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:00.143608 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:00.162014 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:00.164650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:00.165101 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:00.166171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:00.166663 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:00.167627 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:00.303748 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:00.304822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:00.313748 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:00.315009 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:00.315754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:00.316599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:00.317118 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:00.317480 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:00.344295 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:00.359927 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:00.371218 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-58a236d2-490f-424a-9efe-82b14d9c7164 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.240924 Aug 10 11:14:00.371844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 82/163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:00 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:00.498128 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:00.509504 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9144da28-df22-4ead-b5f7-8edf3c4c2207 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.209449 Aug 10 11:14:00.511961 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 82/164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:00 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:00.909355 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:00.911134 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:00.921232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:00.921835 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:00.922924 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:00.924527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:00.925206 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:00.926096 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:01.143678 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:01.145943 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:01.159922 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:01.161114 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:01.162772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:01.164362 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:01.165656 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:01.167368 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:01.185889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:01.198723 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5a974052-4dca-4ba2-af70-82b3b2809869 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1315 microversion: 2.1 time: 0.296340 Aug 10 11:14:01.201086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 83/165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:00 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:01.393012 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:01.393825 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:01.401745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:01.402246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:01.415275 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:01.418628 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:01.419257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:01.419894 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:01.829316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:01.842367 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe2a5e25-61fe-4c0b-8b52-60a3c9bf1a9f tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.706738 Aug 10 11:14:01.847480 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 83/166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:01 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:01.857854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:01.858511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:01.878686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:01.879197 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:01.879646 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:01.880356 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:01.881227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:01.883037 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:02.033809 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:02.043159 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-11a90ce1-aba7-436f-bdea-18cd2ebfd498 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1320 microversion: 2.1 time: 0.654085 Aug 10 11:14:02.050654 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 84/167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:01 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1320 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:02.057977 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5aa63265-bd37-4f4e-821f-b94a8941929f req-d215e789-664a-4dc0-9fc6-b6d3f8368422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416de879-4113-49f9-b2a9-04398bd17e4a", "name": "network-vif-plugged", "status": "completed", "tag": "9b7676b1-1e6e-4948-8893-e526c58468e0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:14:02.076043 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5aa63265-bd37-4f4e-821f-b94a8941929f req-d215e789-664a-4dc0-9fc6-b6d3f8368422 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:02.076779 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5aa63265-bd37-4f4e-821f-b94a8941929f req-d215e789-664a-4dc0-9fc6-b6d3f8368422 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:02.077349 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5aa63265-bd37-4f4e-821f-b94a8941929f req-d215e789-664a-4dc0-9fc6-b6d3f8368422 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:02.092177 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5aa63265-bd37-4f4e-821f-b94a8941929f req-d215e789-664a-4dc0-9fc6-b6d3f8368422 service nova] Creating event network-vif-plugged:9b7676b1-1e6e-4948-8893-e526c58468e0 for instance 416de879-4113-49f9-b2a9-04398bd17e4a on hv-cinder-85272 Aug 10 11:14:02.097469 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:02.098506 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5aa63265-bd37-4f4e-821f-b94a8941929f req-d215e789-664a-4dc0-9fc6-b6d3f8368422 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046332 Aug 10 11:14:02.099235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 85/168] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:14:02.108381 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-47b2c4d0-7e89-4d82-a2cc-e0e8f74c0e56 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.259495 Aug 10 11:14:02.109458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 84/169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:01 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:02.231979 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:02.233511 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:02.246232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:02.246982 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:02.247577 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:02.248570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:02.249160 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:02.249731 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:02.479742 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:02.489007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-18074f86-9a23-482c-8d37-39732f773669 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1501 microversion: 2.1 time: 0.265772 Aug 10 11:14:02.492141 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 86/170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:02 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:02.878088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:02.878846 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:02.902086 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:02.902597 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:02.903037 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:02.903741 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:02.904193 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:02.906060 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:03.080359 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:03.082112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:03.092362 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:03.093404 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:03.094036 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:03.095427 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:03.096031 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:03.096992 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:03.357060 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:03.366150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2c2f3956-cf6e-474d-a770-c79d9d8bafc8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1364 microversion: 2.1 time: 0.500691 Aug 10 11:14:03.371210 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 85/171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:02 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1364 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:03.378322 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:03.382705 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:03.389229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:03.390104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:03.390984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:03.391922 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:03.392666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:03.393355 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:03.407722 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:03.418093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c5a0604b-b7e9-4744-9ccf-c6fd6d302dd0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1513 microversion: 2.1 time: 0.349948 Aug 10 11:14:03.418889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 87/172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:03 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1513 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:03.440616 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:14:03.443462 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:03.454367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:03.455024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:03.455643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:03.456835 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:03.457375 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:03.457965 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:03.553203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lazy-loading 'flavor' on Instance uuid 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:14:03.626023 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:03.634893 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3cec3912-24a2-46f3-870b-dea4e1eff131 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.262219 Aug 10 11:14:03.636007 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 86/173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:03 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:03.685065 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8ac16596-2e41-487e-8050-c9be368d368b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2/action" status: 200 len: 32 microversion: 2.1 time: 0.248549 Aug 10 11:14:03.685673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 88/174] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:14:03 2022] POST /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2/action => generated 32 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 11:14:03.695552 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:03.696262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:03.702278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:03.702922 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:03.703357 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:03.704050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:03.704524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:03.704932 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:03.839130 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:03.845952 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-de29f178-4f91-4def-9ea1-f358589f3a3f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.154543 Aug 10 11:14:03.846526 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 87/175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:03 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:04.394638 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:04.396211 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:04.403514 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:04.403964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:04.404390 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:04.405075 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:04.405684 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:04.406094 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:04.591248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:04.602489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cf7ee8ae-9be3-4954-abed-721360380b0b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1550 microversion: 2.1 time: 0.211953 Aug 10 11:14:04.614883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 89/176] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:04 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1550 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:04.623752 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea305cdf-259f-4f1a-829d-e39973fe0800 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:04.624497 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea305cdf-259f-4f1a-829d-e39973fe0800 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:04.631088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea305cdf-259f-4f1a-829d-e39973fe0800 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:04.631554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea305cdf-259f-4f1a-829d-e39973fe0800 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:04.632089 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea305cdf-259f-4f1a-829d-e39973fe0800 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:04.632997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea305cdf-259f-4f1a-829d-e39973fe0800 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:04.633584 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea305cdf-259f-4f1a-829d-e39973fe0800 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:04.634608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea305cdf-259f-4f1a-829d-e39973fe0800 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:04.657570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:04.658186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:04.664037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:04.664700 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:04.665138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:04.665934 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:04.666385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:04.666876 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:04.672076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:04.794474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea305cdf-259f-4f1a-829d-e39973fe0800 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174609 Aug 10 11:14:04.795130 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 88/177] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 11:14:04 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:14:04.839671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:04.847494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c3b46d2c-9a45-439f-8ba3-c5f3862b9dee tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1366 microversion: 2.1 time: 0.193660 Aug 10 11:14:04.848070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 90/178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:04 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:04.866947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:04.868033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:04.874074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:04.874639 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:04.875325 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:04.876128 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:04.876872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:04.877554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:05.008647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:05.016450 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee962d88-8000-4e58-ab1b-2abab2bc3da5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.153455 Aug 10 11:14:05.017020 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 89/179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:04 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:05.553006 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-74539736-fa67-4bb9-b4fa-504440058029 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f55bea6f-bd0c-42e3-9fca-8f96c10cc2d5"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:14:05.556631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-74539736-fa67-4bb9-b4fa-504440058029 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:05.565464 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-74539736-fa67-4bb9-b4fa-504440058029 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:05.566160 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-74539736-fa67-4bb9-b4fa-504440058029 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:05.567052 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-74539736-fa67-4bb9-b4fa-504440058029 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:05.568450 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-74539736-fa67-4bb9-b4fa-504440058029 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:05.569103 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-74539736-fa67-4bb9-b4fa-504440058029 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:05.569726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-74539736-fa67-4bb9-b4fa-504440058029 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:05.870740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:05.871395 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:05.880650 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:05.881139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:05.881570 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:05.882267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:05.882766 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:05.883347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:06.039342 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:06.048355 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b12bed8b-5c83-46ce-ba4d-a01803a22afa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1556 microversion: 2.1 time: 0.183903 Aug 10 11:14:06.048931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 90/180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:05 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:06.053599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:06.054358 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:06.061017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:06.061671 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:06.062344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:06.063206 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:06.064024 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:06.064643 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:06.253540 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:06.268095 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-efabbc1f-a87a-45ce-a378-86e244827074 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.217930 Aug 10 11:14:06.279303 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 91/181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:06 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:06.283150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-605ef972-1809-4b76-8940-fc9358bcb846 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:06.283902 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-605ef972-1809-4b76-8940-fc9358bcb846 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:06.301268 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-605ef972-1809-4b76-8940-fc9358bcb846 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:06.302871 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-605ef972-1809-4b76-8940-fc9358bcb846 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:06.303327 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-605ef972-1809-4b76-8940-fc9358bcb846 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:06.306960 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-605ef972-1809-4b76-8940-fc9358bcb846 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:06.307592 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-605ef972-1809-4b76-8940-fc9358bcb846 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:06.308675 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-605ef972-1809-4b76-8940-fc9358bcb846 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:06.442374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-605ef972-1809-4b76-8940-fc9358bcb846 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.167165 Aug 10 11:14:06.443004 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 92/182] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 11:14:06 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:14:06.778688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-74539736-fa67-4bb9-b4fa-504440058029 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "POST /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.229624 Aug 10 11:14:06.784541 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 91/183] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:14:05 2022] POST /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1/os-volume_attachments => generated 194 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:14:06.943396 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e4c920af-d346-43fd-9f76-c8624c8845d3 req-760e6c7c-6d22-49fe-a6cf-caee59fac62a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d74ab5-9978-4af6-9fff-34b86d739057", "tag": "90757e23-502d-4a8b-bc8b-3a17f062540c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:14:06.954305 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e4c920af-d346-43fd-9f76-c8624c8845d3 req-760e6c7c-6d22-49fe-a6cf-caee59fac62a service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:06.955191 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e4c920af-d346-43fd-9f76-c8624c8845d3 req-760e6c7c-6d22-49fe-a6cf-caee59fac62a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:06.955911 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e4c920af-d346-43fd-9f76-c8624c8845d3 req-760e6c7c-6d22-49fe-a6cf-caee59fac62a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:06.972951 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e4c920af-d346-43fd-9f76-c8624c8845d3 req-760e6c7c-6d22-49fe-a6cf-caee59fac62a service nova] Creating event network-changed:90757e23-502d-4a8b-bc8b-3a17f062540c for instance b5d74ab5-9978-4af6-9fff-34b86d739057 on hv-cinder-85272 Aug 10 11:14:06.980553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e4c920af-d346-43fd-9f76-c8624c8845d3 req-760e6c7c-6d22-49fe-a6cf-caee59fac62a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040944 Aug 10 11:14:06.986299 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 93/184] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:14:07.295538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:07.297126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:07.315644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:07.316531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:07.317721 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:07.320814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:07.322153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:07.322914 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:07.850486 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:07.867492 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c3114d86-26fa-4b1b-8a65-2d402e85c1ca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.579242 Aug 10 11:14:07.868093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 92/185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:07 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:08.894862 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:08.896090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:08.910072 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:08.917492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:08.918204 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:08.919174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:08.919775 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:08.920346 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:09.059830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-aab34181-e739-4de5-aea4-212b3c40395c req-336e9bc8-ca4d-4418-8bea-f402abbf77a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416de879-4113-49f9-b2a9-04398bd17e4a", "tag": "9b7676b1-1e6e-4948-8893-e526c58468e0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:14:09.077681 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-aab34181-e739-4de5-aea4-212b3c40395c req-336e9bc8-ca4d-4418-8bea-f402abbf77a8 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:09.078171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-aab34181-e739-4de5-aea4-212b3c40395c req-336e9bc8-ca4d-4418-8bea-f402abbf77a8 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:09.078623 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-aab34181-e739-4de5-aea4-212b3c40395c req-336e9bc8-ca4d-4418-8bea-f402abbf77a8 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:09.094350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-aab34181-e739-4de5-aea4-212b3c40395c req-336e9bc8-ca4d-4418-8bea-f402abbf77a8 service nova] Creating event network-changed:9b7676b1-1e6e-4948-8893-e526c58468e0 for instance 416de879-4113-49f9-b2a9-04398bd17e4a on hv-cinder-85272 Aug 10 11:14:09.102532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-aab34181-e739-4de5-aea4-212b3c40395c req-336e9bc8-ca4d-4418-8bea-f402abbf77a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050601 Aug 10 11:14:09.103625 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 93/186] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:14:09.404224 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:09.415774 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ff5fefe9-ad94-437f-8a75-e450d3735581 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.528206 Aug 10 11:14:09.433001 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 94/187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:08 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:10.441801 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:10.443132 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:10.454024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:10.454807 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:10.455408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:10.456832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:10.457439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:10.458525 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:10.716914 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:10.732637 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b85949b4-e74f-4f67-aef8-d8934488a54b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.296854 Aug 10 11:14:10.733455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 94/188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:10 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:11.756718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:11.758110 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:11.765443 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:11.766437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:11.766898 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:11.767987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:11.768637 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:11.769066 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:12.130875 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:12.138216 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a0135b0f-1d06-40cf-aa15-4e4ef5345566 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.386699 Aug 10 11:14:12.139118 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 95/189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:11 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:13.159367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:13.160620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:13.170992 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:13.173072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:13.173780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:13.174890 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:13.175644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:13.176408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:13.350059 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:13.358221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-835e0a0d-2a9a-4508-8bd0-109703a5f0a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.202843 Aug 10 11:14:13.359141 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 95/190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:13 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:14.380609 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:14.381435 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:14.387935 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:14.388416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:14.388855 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:14.389539 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:14.389991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:14.390412 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:14.527401 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:14.535501 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59e746f6-cd72-4dc0-bfb2-06c03304ff80 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.158628 Aug 10 11:14:14.536244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 96/191] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:14 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:15.558088 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:15.558915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:15.565444 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:15.565926 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:15.566366 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:15.567084 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:15.567540 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:15.569713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:15.701744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:15.709304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f0308d59-23d6-4d58-8553-50976c1024df tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.155261 Aug 10 11:14:15.709955 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 96/192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:15 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:16.731994 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:16.732970 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:16.759817 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:16.760311 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:16.761269 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:16.761962 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:16.767123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:16.768757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:16.930338 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:16.939168 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c8b4d63d-6a40-4a69-9fee-481758f35116 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.211353 Aug 10 11:14:16.940106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 97/193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:16 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:17.871013 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:17.871478 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:17.878677 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:17.879546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:17.880188 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:17.881063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:17.881895 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:17.882816 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:17.909912 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:14:17.961313 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:17.961987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:17.969442 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:17.970373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:17.970965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:17.972314 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:17.972821 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:17.973333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:18.016850 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c35023bd-1ce0-4d89-8077-7cc758bc90dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 204 len: 0 microversion: 2.1 time: 0.150565 Aug 10 11:14:18.018441 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 97/194] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:14:17 2022] DELETE /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:14:18.029705 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:18.030865 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:18.040314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:18.041002 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:18.041586 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:18.042973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:18.043570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:18.044201 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:18.191965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:18.200284 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-337192e8-4753-45cf-ac84-6b9a3a8b6204 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.243295 Aug 10 11:14:18.200889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 98/195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:17 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:18.221707 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:18.230504 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f1d63082-7bc1-4577-8b44-06bd036f6380 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.207116 Aug 10 11:14:18.231223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 98/196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:18 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:19.222261 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:19.223516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:19.229932 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:19.230431 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:19.230919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:19.231643 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:19.232159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:19.232594 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:19.252372 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:19.253558 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:19.267455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:19.268158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:19.268753 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:19.269458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:19.269908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:19.270512 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:19.464173 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:19.468136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:19.472635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea243929-8e87-49d4-9e10-8ce1d5bffa92 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.255722 Aug 10 11:14:19.473548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 99/197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:19 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:19.483174 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-54d783b1-ce74-442a-9ee1-c148990952fd tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.235024 Aug 10 11:14:19.483816 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 99/198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:19 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:20.493241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:20.493847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:20.500255 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:20.500925 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:20.501608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:20.502445 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:20.503055 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:20.503628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:20.503936 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:20.504538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:20.512317 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:20.512801 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:20.513653 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:20.514468 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:20.515336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:20.515896 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:20.527119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:20.695868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:20.704514 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d6f5239-d66f-49e7-8432-94048b78c287 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.215066 Aug 10 11:14:20.705243 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 100/199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:20 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:20.730788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:20.739227 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3ad02c38-59ab-4047-818b-43c3660827e9 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.239021 Aug 10 11:14:20.739797 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 100/200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:20 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:21.724368 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:21.724910 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:21.731474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:21.731948 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:21.732376 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:21.733059 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:21.733504 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:21.733922 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:21.762160 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:21.762800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:21.768951 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:21.769434 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:21.769871 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:21.770566 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:21.771176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:21.771608 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:21.916413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:21.923845 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4e67db1e-c430-4815-a78d-caeef7fdca2b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.203402 Aug 10 11:14:21.924412 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 101/201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:21 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:21.941562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:21.950001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fab17dc9-86b7-4732-92f8-5a3213bd9c9c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.192529 Aug 10 11:14:21.950601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 101/202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:21 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:22.944174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:22.944774 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:22.950600 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:22.951076 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:22.951508 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:22.952180 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:22.952626 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:22.953043 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:22.970524 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:22.971384 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:22.977569 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:22.978051 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:22.978496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:22.979874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:22.980332 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:22.980755 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:23.154872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:23.157188 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:23.165919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7022b8d8-9d7d-44d6-83a7-748cd298e5d4 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.199198 Aug 10 11:14:23.166483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 102/203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:22 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:23.167595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b403ee5-7fc1-4087-9db4-28506a722457 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.225873 Aug 10 11:14:23.168305 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 102/204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:22 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:24.188374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:24.188954 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:24.188954 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:24.189393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:24.190760 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=66 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:24.195462 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:24.195807 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:24.195937 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:24.196281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:24.196377 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:24.196705 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:24.197032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:24.197379 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:24.197483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:24.198324 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:24.198464 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:24.198763 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:24.393896 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:24.397429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:24.401703 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6e349e3d-0d2a-4df2-9947-14f30b8e2554 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.217148 Aug 10 11:14:24.402270 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 103/205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:24 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:24.404916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fb24e0ec-5949-446a-a9ea-9ebef620198c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.220360 Aug 10 11:14:24.405477 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 103/206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:24 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:25.422775 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:25.423384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:25.424880 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:25.425491 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:25.427968 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:25.429657 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:25.430520 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:25.431044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:25.431737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:25.432745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:25.433172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:25.434247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:25.434760 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:25.435196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:25.435887 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:25.436337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:25.436762 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:25.452373 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:25.633157 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:25.638336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:25.641037 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d68c4111-beac-418d-a963-085dccb33174 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.222102 Aug 10 11:14:25.641807 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 104/207] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:25 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:25.646262 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e989f64b-7fc6-4337-a202-9474d8b56096 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.225089 Aug 10 11:14:25.646863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 104/208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:25 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:26.661928 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:26.662587 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:26.666323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:26.666997 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:26.668478 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:26.668959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:26.669388 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:26.670109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:26.670557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:26.671003 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:26.673852 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:26.674337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:26.674816 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:26.675510 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:26.675968 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:26.676394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:26.866690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:26.875329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b11682c3-335a-4d74-97f5-0bc846a12445 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.217191 Aug 10 11:14:26.875905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 105/209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:26 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:26.881776 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:26.889847 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-133260f4-fda4-405c-b1de-32ade2d0ccf0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.227370 Aug 10 11:14:26.890403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 105/210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:26 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:27.896070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:27.896676 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:27.903246 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:27.903725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:27.904157 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:27.904837 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:27.905289 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:27.905710 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:27.910043 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:27.910690 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:27.916938 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:27.917407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:27.917833 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:27.918515 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:27.918982 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:27.919396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:28.101607 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:28.110405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eb2de1db-38ab-430f-aa8e-426cb52cc117 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.218090 Aug 10 11:14:28.110964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:28.111103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 106/211] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:27 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:28.118615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cc2b4445-aca9-4fef-91fb-76e07b9080b4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.212242 Aug 10 11:14:28.119119 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 106/212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:27 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:29.130483 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:29.131148 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:29.137170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:29.137656 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:29.138088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:29.138804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:29.139218 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:29.139309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:29.139398 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:29.139674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:29.145665 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:29.146145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:29.146598 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:29.147293 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:29.147743 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:29.148169 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:29.332877 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:29.335892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:29.341449 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3dd3da1-ecde-4082-8581-4388a861ba8c tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.214837 Aug 10 11:14:29.342207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 107/213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:29 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:29.344085 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-69444237-59fe-46c3-acfb-4151aecb0251 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.209157 Aug 10 11:14:29.344642 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 107/214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:29 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:30.362837 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:30.363448 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:30.364644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:30.365254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:30.369426 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:30.370402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:30.370858 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:30.371554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:30.372007 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:30.372360 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:30.372462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:30.372997 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:30.373437 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:30.374160 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:30.374643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:30.375254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:30.563666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:30.570745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:30.571532 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-36751922-9ec1-48c5-a35d-bc9f33dd24dc tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.212650 Aug 10 11:14:30.572110 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 108/215] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:30 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:30.578958 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fbd21249-6a15-4d53-b71e-39830ad1d72f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.217945 Aug 10 11:14:30.579515 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 108/216] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:30 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:31.592759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:31.593310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:31.599228 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:31.599647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:31.599839 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:31.599940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:31.600301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:31.600996 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:31.601451 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:31.601874 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:31.607045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:31.607562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:31.608042 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:31.608735 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:31.609191 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:31.609618 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:31.792263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:31.796183 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:31.800353 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c0c84d11-1166-439a-a365-353b0898c594 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.211472 Aug 10 11:14:31.800929 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 109/217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:31 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:31.803575 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c9a4ca39-de79-4668-98ce-8e515687abee tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.208094 Aug 10 11:14:31.804137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 109/218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:31 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:32.821758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:32.822374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:32.824526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:32.825140 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:32.828409 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:32.828897 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:32.829334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:32.830022 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:32.830476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:32.830931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:32.831303 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:32.831784 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:32.832222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:32.832911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:32.833361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:32.833791 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:33.027371 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:33.030345 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:33.035423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-99b29d3c-10c1-4ddf-8670-bd71e77ec8f2 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1553 microversion: 2.1 time: 0.217545 Aug 10 11:14:33.035998 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 110/219] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:32 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:33.037950 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ad441e02-7b66-4dcf-bf89-db12c3da4eca tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.217273 Aug 10 11:14:33.038650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 110/220] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:32 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:33.707603 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b4a4338e-1787-4c64-896f-c40fe7e5c526 req-71463d9c-3473-434c-81dc-eef995837fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8a23cc-cf69-422f-9db5-4853e16830d1", "name": "network-vif-deleted", "tag": "98a70eeb-8b46-4c95-bf6f-051b64107251"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:14:33.718086 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4a4338e-1787-4c64-896f-c40fe7e5c526 req-71463d9c-3473-434c-81dc-eef995837fa1 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:33.718665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4a4338e-1787-4c64-896f-c40fe7e5c526 req-71463d9c-3473-434c-81dc-eef995837fa1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:33.719021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4a4338e-1787-4c64-896f-c40fe7e5c526 req-71463d9c-3473-434c-81dc-eef995837fa1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:33.732705 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b4a4338e-1787-4c64-896f-c40fe7e5c526 req-71463d9c-3473-434c-81dc-eef995837fa1 service nova] Creating event network-vif-deleted:98a70eeb-8b46-4c95-bf6f-051b64107251 for instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 on hv-cinder-85272 Aug 10 11:14:33.737786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b4a4338e-1787-4c64-896f-c40fe7e5c526 req-71463d9c-3473-434c-81dc-eef995837fa1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033797 Aug 10 11:14:33.738838 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 111/221] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:14:34.056335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:34.056948 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:34.059860 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:34.060553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:34.064260 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:34.064745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:34.065177 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:34.065868 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:34.066318 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:34.066472 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:34.066768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:34.066981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:34.067412 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:34.068091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:34.068537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:34.068954 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:34.149330 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:34.157817 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-968c5735-534b-4cde-84bd-5e966f8faa69 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1346 microversion: 2.1 time: 0.105570 Aug 10 11:14:34.158395 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 111/222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:34 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:34.216373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:34.223832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-34a40670-c3c3-4662-8c4e-32300f670034 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.169163 Aug 10 11:14:34.224426 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 112/223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:34 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:35.186613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:35.187218 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:35.193868 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:35.194351 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:35.194818 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:35.195504 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:35.195956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:35.196393 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:35.229830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:35.230309 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:35.230770 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:35.231213 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lazy-loading 'fault' on Instance uuid 9b8a23cc-cf69-422f-9db5-4853e16830d1 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:14:35.246760 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:35.247429 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:35.253503 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:35.254105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:35.255512 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:35.256546 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:35.257088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:35.258019 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:35.281064 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59246460c1846ac82200f4516f2507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450e17cbc2104fcba833fc48ada83cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:35.289674 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-82f48673-ccc3-400f-ad1c-968bd0847043 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 200 len: 1351 microversion: 2.1 time: 0.108028 Aug 10 11:14:35.290240 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 112/224] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:35 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:35.405224 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:35.418875 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2b5ff385-51f6-4675-9af4-c75780b4dd95 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.177113 Aug 10 11:14:35.419450 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 113/225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:35 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:36.314077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:36.314852 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:36.321675 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:36.322291 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:36.322891 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:36.323678 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:36.324272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:36.324795 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:36.339464 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] HTTP exception thrown: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Request method failure captured: Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 HTTP/1.1 Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LGlM0cQdQ21C5ZSw8CXV28YrvPcMj7ZLSr3KN9QV0KfSTochs1Szx3SgnxBbDJmNCGAQs0LSeJHpqAFUPZxNTxuOuQDQZEjk4Ami3xMbFFwd9cCfGHvn0HNaYf7Z4HXtNagV4phIZYxMILemBABhKccHTWukJj2SDEpdgK1Kpc1I0 Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 450e17cbc2104fcba833fc48ada83cda Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:14:36.344688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 450e17cbc2104fcba833fc48ada83cda Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-DeleteServersTestJSON-2055765125-project Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: a59246460c1846ac82200f4516f2507f Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-DeleteServersTestJSON-2055765125-project Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.346250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '9b8a23cc-cf69-422f-9db5-4853e16830d1'} Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:14:36.347225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.348529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.349701 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Returning 404 to user: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:14:36.350285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e6f2717a-e9bd-49a0-974a-aa011766ae5a tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 404 len: 111 microversion: 2.1 time: 0.041881 Aug 10 11:14:36.350893 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 113/226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:36 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:14:36.440527 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:36.441126 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:36.448880 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:36.449576 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:36.450192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:36.451096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:36.451694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:36.452121 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:36.483657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:36.486038 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:36.498327 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:36.502194 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:36.502892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:36.504714 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:36.507038 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:36.511891 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:36.537254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] HTTP exception thrown: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Request method failure captured: Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1/os-volume_attachments HTTP/1.1 Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LGlM0cQdQ21C5ZSw8CXV28YrvPcMj7ZLSr3KN9QV0KfSTochs1Szx3SgnxBbDJmNCGAQs0LSeJHpqAFUPZxNTxuOuQDQZEjk4Ami3xMbFFwd9cCfGHvn0HNaYf7Z4HXtNagV4phIZYxMILemBABhKccHTWukJj2SDEpdgK1Kpc1I0 Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 450e17cbc2104fcba833fc48ada83cda Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:14:36.549794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 450e17cbc2104fcba833fc48ada83cda Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-DeleteServersTestJSON-2055765125-project Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: a59246460c1846ac82200f4516f2507f Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-DeleteServersTestJSON-2055765125-project Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.551107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'server_id': '9b8a23cc-cf69-422f-9db5-4853e16830d1'} Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:14:36.551764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:36.552812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:36.555591 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Returning 404 to user: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:14:36.556703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5d07f108-9038-49e2-944b-2bbdf5e56368 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.077517 Aug 10 11:14:36.562054 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 114/227] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:14:36 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1/os-volume_attachments => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:14:36.665746 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:36.675527 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6dd45327-cdba-4a01-a0cf-eed4e100f929 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.238694 Aug 10 11:14:36.687948 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 114/228] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:36 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:37.699077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:37.699689 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:37.705780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:37.706266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:37.706731 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:37.707603 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:37.708052 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:37.708472 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:38.040065 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:38.048999 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cf37ad61-f4d0-49e0-ad77-8f0b00aa9453 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.354405 Aug 10 11:14:38.050318 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 115/229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:37 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:39.071346 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:39.071949 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:39.078283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:39.078799 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:39.079229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:39.079959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:39.080568 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:39.080991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:39.212390 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:39.219801 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e19c595e-9317-433a-8455-1a51d3372c46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.152750 Aug 10 11:14:39.220242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 115/230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:39 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:40.239891 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:40.240499 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:40.247426 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:40.247911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:40.248347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:40.249036 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:40.249489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:40.249916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:40.400230 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:40.408073 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-07464f2c-3cd9-49e7-bf22-7f66e2d435e4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.172022 Aug 10 11:14:40.408678 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 116/231] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:40 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:40.991616 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:40.992137 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:40.999920 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:41.001076 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:41.001076 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:41.001722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:41.002199 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:41.002620 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:41.025226 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] HTTP exception thrown: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Request method failure captured: Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 HTTP/1.1 Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LGlM0cQdQ21C5ZSw8CXV28YrvPcMj7ZLSr3KN9QV0KfSTochs1Szx3SgnxBbDJmNCGAQs0LSeJHpqAFUPZxNTxuOuQDQZEjk4Ami3xMbFFwd9cCfGHvn0HNaYf7Z4HXtNagV4phIZYxMILemBABhKccHTWukJj2SDEpdgK1Kpc1I0 Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 450e17cbc2104fcba833fc48ada83cda Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:14:41.031523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 450e17cbc2104fcba833fc48ada83cda Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-2055765125-project Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: a59246460c1846ac82200f4516f2507f Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-2055765125-project Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.032758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '9b8a23cc-cf69-422f-9db5-4853e16830d1'} Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:14:41.034085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.035172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.036236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Returning 404 to user: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:14:41.036236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f0e4fa8e-24e2-4cc5-9523-8ae0c3aae578 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 404 len: 111 microversion: 2.1 time: 0.046214 Aug 10 11:14:41.036236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 116/232] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:14:40 2022] DELETE /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:14:41.043883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:41.045782 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] [instance: 9b8a23cc-cf69-422f-9db5-4853e16830d1] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:41.054235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:41.054547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:41.055024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:41.056039 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:41.056501 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:41.056927 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:41.074966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] HTTP exception thrown: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Request method failure captured: Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 HTTP/1.1 Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LGlM0cQdQ21C5ZSw8CXV28YrvPcMj7ZLSr3KN9QV0KfSTochs1Szx3SgnxBbDJmNCGAQs0LSeJHpqAFUPZxNTxuOuQDQZEjk4Ami3xMbFFwd9cCfGHvn0HNaYf7Z4HXtNagV4phIZYxMILemBABhKccHTWukJj2SDEpdgK1Kpc1I0 Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 450e17cbc2104fcba833fc48ada83cda Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:14:41.076634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_450e17cbc2104fcba833fc48ada83cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 450e17cbc2104fcba833fc48ada83cda Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-DeleteServersTestJSON-2055765125 Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-DeleteServersTestJSON-2055765125-project Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: a59246460c1846ac82200f4516f2507f Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-DeleteServersTestJSON-2055765125-project Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.078063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '9b8a23cc-cf69-422f-9db5-4853e16830d1'} Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:14:41.078901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. Aug 10 11:14:41.080254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:14:41.081455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] Returning 404 to user: Instance 9b8a23cc-cf69-422f-9db5-4853e16830d1 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:14:41.081455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4eacb96a-e9ce-4037-bd28-976e679c4bd1 tempest-DeleteServersTestJSON-2055765125 tempest-DeleteServersTestJSON-2055765125-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1" status: 404 len: 111 microversion: 2.1 time: 0.038967 Aug 10 11:14:41.081455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 117/233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:41 2022] GET /compute/v2.1/servers/9b8a23cc-cf69-422f-9db5-4853e16830d1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:14:41.437526 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:41.438176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:41.449163 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:41.449650 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:41.450077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:41.450802 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:41.451244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:41.455457 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:41.653195 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:41.664563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b53a251-0ea0-4934-9788-d5767677ef6b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.237405 Aug 10 11:14:41.665303 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 117/234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:41 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:42.686083 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:42.686729 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:42.693153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:42.693640 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:42.694089 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:42.694802 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:42.695259 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:42.695683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:42.824900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:42.832477 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-58a9bc41-f70b-4347-a1ad-1d15b8687c2a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.150792 Aug 10 11:14:42.833037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 118/235] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:42 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:43.858254 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:43.858828 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:43.870666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:43.871384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:43.872059 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:43.872781 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:43.873265 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:43.873694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:43.893465 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:44.013623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:44.021006 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00803e72-7b95-4198-9fc7-bfefa143aabf tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.171524 Aug 10 11:14:44.021572 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 118/236] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:43 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:45.043279 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:45.043933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:45.051314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:45.051916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:45.052346 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:45.053237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:45.053687 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:45.054131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:45.194382 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:45.202757 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e26e91ba-efe9-4625-9980-f56fe9cea2c5 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.165356 Aug 10 11:14:45.203323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 119/237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:45 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:46.224185 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:46.224726 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:46.230824 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:46.231311 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:46.231946 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:46.233303 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:46.233848 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:46.235066 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:46.475890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:46.484217 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a2bab7f8-ad8e-4737-ba61-910927355852 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.264139 Aug 10 11:14:46.484778 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 119/238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:46 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:47.506148 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:47.508425 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:47.517253 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:47.518988 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:47.519671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:47.531828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:47.531828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:47.531828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:47.889377 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:47.897642 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5d1108e0-1f05-48da-a8fe-dec8e1dc7015 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.396139 Aug 10 11:14:47.898544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 120/239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:47 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:48.925955 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:48.927299 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:48.934496 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:48.935013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:48.935447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:48.941089 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:48.942073 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:48.942517 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:49.133814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:49.145226 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b59715c9-5120-42e3-8ae2-09360b49d853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.230168 Aug 10 11:14:49.158912 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 120/240] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:48 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:50.167764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:50.170029 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:50.176887 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:50.177497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:50.178036 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:50.179157 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:50.179814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:50.181407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:50.348517 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:50.359078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-126a4101-6b0f-4ac6-a551-7432e00dda91 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.195135 Aug 10 11:14:50.359736 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 121/241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:50 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:50.907533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e0f10e16-7126-4065-b55b-683dd597e8f8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'create', calling method: .version_select at 0x7fccf82b9af0>, body: {"keypair": {"name": "tempest-keypair-1931215633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOp2C5qT/f+gX7UVWvcEOu2Rq5yCMgwS87GEnU5CL3+HC4dHk5cux4uCbubm0vLxx5vgq1tiXACmvM/aleCTCR9dq3N0ya5ht8Zen6scGkHEi/NZqMiUVBF+QmpRqAeMQ=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:14:50.925596 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-e0f10e16-7126-4065-b55b-683dd597e8f8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Getting quotas for project 0a19aabba33c4e0ab7b3f2d9d58ec621. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:14:50.929696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-e0f10e16-7126-4065-b55b-683dd597e8f8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Getting quotas for user 1f000354b524462bb66812138c6e4695 and project 0a19aabba33c4e0ab7b3f2d9d58ec621. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:14:50.955534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e0f10e16-7126-4065-b55b-683dd597e8f8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.185366 Aug 10 11:14:50.961542 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 121/242] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 10 11:14:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 11:14:51.381530 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:51.382259 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:51.389204 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:51.389691 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:51.390158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:51.391040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:51.391523 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:51.391956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:51.545538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:51.548092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:51.559792 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c3ca6481-4bdc-477c-b4f9-a4827ae2b423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.182444 Aug 10 11:14:51.560651 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 122/243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:51 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:52.279224 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-483652578", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "123e1a3f-132b-4e54-8cad-553dfa7b8f8b"}], "security_groups": [{"name": "tempest-securitygroup--803946545"}], "key_name": "tempest-keypair-1931215633", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:14:52.580905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:52.581325 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:52.589760 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:52.590247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:52.590892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:52.591905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:52.592506 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:52.593078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:52.740519 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:52.748075 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d1a8873c-457c-4cd3-887a-0a8fd57f59ae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.171415 Aug 10 11:14:52.748640 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 123/244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:52 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:53.770635 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:53.771519 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:53.778431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:53.778948 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:53.779387 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:53.780092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:53.780580 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:53.781217 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:53.932871 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:53.940856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4314b94f-7095-4ba3-aea9-2df3c88ea033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.174039 Aug 10 11:14:53.941439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 124/245] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:53 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:54.961526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:54.962143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:54.969176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:54.969650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:54.970084 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:54.970793 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:54.971241 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:54.971663 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:55.108515 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:55.116406 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d00f8030-6e10-4a3f-b54f-dd3027264617 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.158723 Aug 10 11:14:55.116979 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 125/246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:54 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:56.144565 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:56.145293 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:56.149582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=46 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:56.154220 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:56.154732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:56.155449 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:56.156158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:56.156611 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:56.157131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:56.287867 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:56.295461 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-349d470c-f5b7-4802-8613-ccaceafdd8b7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.160909 Aug 10 11:14:56.296019 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 126/247] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:56 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:14:57.316298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:57.316954 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:57.323730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:57.324222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:57.324655 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:57.325332 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:57.325777 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:57.326200 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:57.462508 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:57.470383 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2cba010c-d6f0-4766-9cdb-baf1008811a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.157931 Aug 10 11:14:57.471067 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 127/248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:57 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:58.491500 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:58.492148 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:58.499043 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:58.499521 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:58.499955 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:58.500635 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:58.501085 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:58.501505 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:58.634727 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:58.643683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8e9506ab-b8dd-47f0-ad3e-697057aa5032 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.156036 Aug 10 11:14:58.644265 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 128/249] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:58 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:14:59.144556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=14 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:59.664197 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:59.664819 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:14:59.671113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:59.671600 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:59.672039 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:59.672743 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:14:59.673202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:14:59.673627 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:14:59.805147 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:14:59.813566 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-60dc8334-795f-41fb-881a-d9f022c71f7b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.153180 Aug 10 11:14:59.814124 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 129/250] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:14:59 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:00.834635 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:00.835284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:00.843491 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:00.844285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:00.844925 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:00.845889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:00.846547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:00.847066 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:00.937320 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:00.985078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:00.992591 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f42c2406-b921-48c0-97a7-c10fde8aad49 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.161908 Aug 10 11:15:00.993151 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 130/251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:00 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:02.014766 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:02.015531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:02.021887 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:02.022720 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:02.023416 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:02.024355 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:02.025114 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:02.025788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:02.255094 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:02.273216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-499f656c-b446-4376-9f18-99f37caa2b9f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.263800 Aug 10 11:15:02.274549 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 131/252] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:02 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:02.295578 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:03.213462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] validate_networks() for [('123e1a3f-132b-4e54-8cad-553dfa7b8f8b', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:15:03.297093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:03.303267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:03.315538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:03.316704 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:03.317301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:03.318099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:03.318679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:03.319331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:03.615989 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:03.625486 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cec3cbb5-ba57-4868-b6a5-f74e39358941 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1519 microversion: 2.1 time: 0.335393 Aug 10 11:15:03.626083 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 132/253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:03 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:03.782157 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:15:03.782801 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:15:03.783076 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:15:03.783489 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:15:03.783905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:15:03.793549 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:03.794033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:03.794467 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:03.795226 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:03.795680 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:03.796098 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:03.814849 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Getting quotas for project 0a19aabba33c4e0ab7b3f2d9d58ec621. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:15:03.821009 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Getting quotas for user 1f000354b524462bb66812138c6e4695 and project 0a19aabba33c4e0ab7b3f2d9d58ec621. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:15:03.834903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:15:03.837216 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:15:03.894510 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee62e0c8-71de-4976-b6cf-e3b756a697dc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 11.619622 Aug 10 11:15:03.895762 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 122/254] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 10 11:14:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 11621 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 11:15:03.907824 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-490b0ddb-34da-4abf-9c60-71100717f3f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:03.908738 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-490b0ddb-34da-4abf-9c60-71100717f3f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:03.977461 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-490b0ddb-34da-4abf-9c60-71100717f3f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:03.987447 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-490b0ddb-34da-4abf-9c60-71100717f3f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:03.989113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-490b0ddb-34da-4abf-9c60-71100717f3f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:03.990336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-490b0ddb-34da-4abf-9c60-71100717f3f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1281 microversion: 2.20 time: 0.087911 Aug 10 11:15:03.991204 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 133/255] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:03 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:15:04.652388 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:04.653664 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:04.661317 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:04.661805 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:04.662510 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:04.663107 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:04.663563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:04.664045 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:04.827796 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:04.835192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ab45dcac-4a84-456e-89fa-e551f9c32ca1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1499 microversion: 2.1 time: 0.190158 Aug 10 11:15:04.835776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 123/256] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:04 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1499 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:04.856773 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:04.857501 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:04.864148 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:04.864719 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:04.865164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:04.865863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:04.866314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:04.866762 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:04.996795 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:05.004368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b672059f-0448-4722-86b2-c929939e89a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1514 microversion: 2.1 time: 0.152102 Aug 10 11:15:05.005090 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 134/257] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:04 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:05.014872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:05.015502 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:05.021550 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:05.022029 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:05.022458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:05.023175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:05.023622 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:05.024043 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:05.092012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:05.100559 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:05.102080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:05.103389 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fa848e8f-e644-43f7-ac96-1c03de34f6f6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1333 microversion: 2.20 time: 0.092641 Aug 10 11:15:05.118761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 124/258] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:05 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:06.127137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:06.127896 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:06.134719 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:06.135234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:06.135673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:06.136370 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:06.136819 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:06.137239 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:06.222390 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:06.234193 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:06.236416 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:06.237658 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5fd48df0-c112-45c5-88f8-8be5b58c569c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1339 microversion: 2.20 time: 0.114893 Aug 10 11:15:06.238219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 135/259] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:06 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1339 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:07.261315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:07.262158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:07.269151 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:07.269852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:07.270282 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:07.271018 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:07.271467 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:07.271881 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:07.558431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:07.561294 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:07.568061 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:07.568540 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:07.569180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:07.569884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:07.570331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:07.570783 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:07.597793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:07.598831 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lazy-loading 'flavor' on Instance uuid 265d9c1c-b86e-449c-a651-b8bc81225a88 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:15:07.614950 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:07.619074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:07.620726 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cd616266-46f3-4340-aec2-83e5379c901c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1406 microversion: 2.20 time: 0.364013 Aug 10 11:15:07.625290 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 125/260] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:07 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1406 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:07.728439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-35c076c3-55d9-4a56-a16e-ac20338c0f19 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88/action" status: 200 len: 32 microversion: 2.1 time: 0.174018 Aug 10 11:15:07.748000 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-04ffc3f8-cc2b-47af-b5ee-f9c4b07496c9 req-ef3ba1cf-47f8-4c50-9c2f-acd38e1d7460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee85970-24fd-4e03-9c90-460c66ab82e9", "tag": "7396eb48-6699-42c7-8c7f-8122d6c9707a"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:07.749476 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 136/261] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:15:07 2022] POST /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 11:15:07.776539 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-04ffc3f8-cc2b-47af-b5ee-f9c4b07496c9 req-ef3ba1cf-47f8-4c50-9c2f-acd38e1d7460 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:07.777029 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-04ffc3f8-cc2b-47af-b5ee-f9c4b07496c9 req-ef3ba1cf-47f8-4c50-9c2f-acd38e1d7460 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:07.777465 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-04ffc3f8-cc2b-47af-b5ee-f9c4b07496c9 req-ef3ba1cf-47f8-4c50-9c2f-acd38e1d7460 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:07.784370 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:07.785708 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:07.798300 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:07.799079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:07.800042 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:07.801925 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:07.802671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:07.803520 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:07.828920 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-04ffc3f8-cc2b-47af-b5ee-f9c4b07496c9 req-ef3ba1cf-47f8-4c50-9c2f-acd38e1d7460 service nova] Creating event network-changed:7396eb48-6699-42c7-8c7f-8122d6c9707a for instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 on hv-cinder-85272 Aug 10 11:15:07.858318 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-04ffc3f8-cc2b-47af-b5ee-f9c4b07496c9 req-ef3ba1cf-47f8-4c50-9c2f-acd38e1d7460 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122937 Aug 10 11:15:07.863358 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 126/262] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:15:08.109455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:08.120299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5ffbf075-af5a-4da3-a6b9-ad306a7f95f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.366292 Aug 10 11:15:08.145039 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 137/263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:07 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:08.651339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:08.652855 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:08.674499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:08.675630 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:08.676162 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:08.676894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:08.677354 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:08.677780 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:08.858950 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:08.887422 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:08.888962 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:08.890091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1d4cca9a-c3c2-42f6-82c4-4f939da30471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1406 microversion: 2.20 time: 0.248671 Aug 10 11:15:08.908833 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 127/264] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:08 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:09.144213 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:09.144991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:09.151830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:09.152310 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:09.153156 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:09.154176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:09.155061 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:09.155485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:09.171058 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:09.322235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:09.330408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-88d4da16-1564-46b0-ae3b-f0272bd020d2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.190199 Aug 10 11:15:09.331033 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 138/265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:09 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:09.921818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:09.924302 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:09.942356 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:09.942888 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:09.945127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:09.945866 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:09.946329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:09.950265 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:10.158073 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:10.171698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:10.174027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:10.175265 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffeccb04-8cc4-49c3-9e39-58c4e4cca67c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1406 microversion: 2.20 time: 0.263857 Aug 10 11:15:10.176151 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 128/266] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:09 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:10.354024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:10.355868 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:10.364523 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:10.365025 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:10.365467 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:10.366176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:10.366660 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:10.367095 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:10.569745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:10.579050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e8cce1ef-35ca-4ead-930f-c0dfeb48f06f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.229113 Aug 10 11:15:10.579635 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 139/267] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:10 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:11.198773 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:11.200082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:11.205947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:11.214682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:11.214852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:11.215737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:11.216210 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:11.217184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:11.368203 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:11.377287 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:11.378820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:11.379928 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-27068d40-957d-42aa-b75b-db5320213626 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1406 microversion: 2.20 time: 0.185991 Aug 10 11:15:11.380484 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 129/268] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:11 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:11.604863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:11.605527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:11.617846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:11.620679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:11.621659 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:11.622998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:11.624625 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:11.627134 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:11.788813 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:11.797208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d484874e-21bc-4b86-9b13-d11e3031e631 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.199749 Aug 10 11:15:11.797895 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 140/269] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:11 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:12.401805 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:12.402413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:12.410087 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:12.410827 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:12.411267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:12.411978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:12.412432 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:12.415154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:12.591033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:12.600811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:12.606519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:12.610114 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0cd7fa4c-0f88-4b40-b956-c21df901c07f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1406 microversion: 2.20 time: 0.212628 Aug 10 11:15:12.611582 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 130/270] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:12 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:12.818920 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:12.820608 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:12.848268 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:12.855276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:12.856632 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:12.858135 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:12.861453 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:12.861982 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:13.173099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:13.191304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0bb4448c-838c-44a8-8f0a-d569165b7148 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.375525 Aug 10 11:15:13.192391 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 141/271] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:12 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:13.633242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:13.633853 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:13.639827 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:13.640376 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:13.640908 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:13.641606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:13.642063 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:13.642482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:13.805503 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:13.831255 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:13.862282 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:13.874843 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:13.876813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:13.878195 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6db2972c-9d39-496e-9640-8df3b380568e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1406 microversion: 2.20 time: 0.248823 Aug 10 11:15:13.879189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 131/272] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:13 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:14.214712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:14.216529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:14.221749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:14.244307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:14.246026 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:14.247213 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:14.248149 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:14.252247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:14.253712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:14.544170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:14.563908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-608e53d6-cfb4-490c-8b65-97efb3ed282e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.354446 Aug 10 11:15:14.564682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 142/273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:14 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:14.901521 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:14.902792 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:14.913461 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:14.914204 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:14.918696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:14.920160 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:14.920911 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:14.921527 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:15.160373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:15.187485 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:15.189122 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:15.190473 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dd28a6f2-bcfc-43a7-8559-4ec1bc916aa4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1406 microversion: 2.20 time: 0.293033 Aug 10 11:15:15.204799 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 132/274] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:14 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:15.585611 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:15.587123 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:15.594748 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:15.596562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:15.598084 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:15.599165 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:15.599867 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:15.600514 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:15.784480 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:15.792975 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-17431b7c-3380-4b34-8964-058fcf604d58 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.211820 Aug 10 11:15:15.795632 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 143/275] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:15 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:15.854863 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-3648a0cc-e266-46e8-b3b1-4568d57fe663 req-51b5e74f-d65b-4358-9c1a-e912ebd3cbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee85970-24fd-4e03-9c90-460c66ab82e9", "name": "network-vif-plugged", "status": "completed", "tag": "7396eb48-6699-42c7-8c7f-8122d6c9707a"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:15.875066 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3648a0cc-e266-46e8-b3b1-4568d57fe663 req-51b5e74f-d65b-4358-9c1a-e912ebd3cbe6 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:15.875968 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3648a0cc-e266-46e8-b3b1-4568d57fe663 req-51b5e74f-d65b-4358-9c1a-e912ebd3cbe6 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:15.876619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3648a0cc-e266-46e8-b3b1-4568d57fe663 req-51b5e74f-d65b-4358-9c1a-e912ebd3cbe6 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:15.902097 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-3648a0cc-e266-46e8-b3b1-4568d57fe663 req-51b5e74f-d65b-4358-9c1a-e912ebd3cbe6 service nova] Creating event network-vif-plugged:7396eb48-6699-42c7-8c7f-8122d6c9707a for instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 on hv-cinder-85272 Aug 10 11:15:15.914095 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-3648a0cc-e266-46e8-b3b1-4568d57fe663 req-51b5e74f-d65b-4358-9c1a-e912ebd3cbe6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064507 Aug 10 11:15:15.916043 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 133/276] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:16.215841 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:16.216643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:16.223328 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:16.223822 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:16.224258 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:16.225153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:16.225602 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:16.226184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:16.817344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:16.818085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:16.824996 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:16.825808 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:16.826501 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:16.827503 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:16.828179 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:16.828823 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:16.877252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:16.894444 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:16.896249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:16.900049 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-93ee0e84-51ce-45f5-a1bf-6d8f59e15664 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1406 microversion: 2.20 time: 0.688600 Aug 10 11:15:16.914973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 144/277] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:16 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1406 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:17.090713 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:17.111859 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-48047a34-4a52-4841-8852-844bc1146039 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.298855 Aug 10 11:15:17.112444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 134/278] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:16 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:17.923847 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:17.924969 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:17.933202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:17.933954 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:17.934681 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:17.936076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:17.937120 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:17.937931 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:18.133709 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:18.136477 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:18.143482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:18.144832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:18.147103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:18.149603 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:18.151834 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:18.152707 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:18.185528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:18.196232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:18.198402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:18.199502 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cae166e3-0dc1-4e3f-8b15-a39d1e37af27 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1406 microversion: 2.20 time: 0.279576 Aug 10 11:15:18.200092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 145/279] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:17 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:18.424223 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:18.437821 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d31bd130-f4e9-473e-a040-52de0c3b5a4e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.308342 Aug 10 11:15:18.438426 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 135/280] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:18 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:18.960767 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-475720ea-915f-40c1-98eb-cb946fe0f389 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Action: 'create', calling method: .version_select at 0x7fccf8366a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-800106665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVigEYbwJ3GoibtwhRa9nx9jzRgz0bIclsc3/vnc3Thn7kqMU5KF9f6RV1qE0mifrMrtm9TIBCsS7yW/ps8tIv8+Qjt0HTy9xxpRlxz1SDZfeY3dyFt4DYJSM9eQ8y18w=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:18.998784 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-475720ea-915f-40c1-98eb-cb946fe0f389 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Getting quotas for project 79389800e0ea49d3b5abfbefe17960ac. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:15:19.003746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-475720ea-915f-40c1-98eb-cb946fe0f389 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Getting quotas for user 7ebc052a3cb6400a961c1b9d9bec83d6 and project 79389800e0ea49d3b5abfbefe17960ac. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:15:19.044597 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-475720ea-915f-40c1-98eb-cb946fe0f389 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.275862 Aug 10 11:15:19.045270 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 146/281] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:15:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:19.223350 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:19.239730 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:19.247971 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:19.248739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:19.251237 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:19.252171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:19.252746 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:19.253289 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:19.445197 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:19.453928 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:19.457662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:19.459396 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b2062c8-740a-4b9e-9140-7eda1a42bd21 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1598 microversion: 2.20 time: 0.241565 Aug 10 11:15:19.460070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 136/282] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:15:19 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1598 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:15:19.464991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:19.465768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:19.474357 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:19.474890 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:19.475329 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:19.476087 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:19.476547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:19.476972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:19.488591 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-39d52f7a-ec86-4f27-8407-81778e88ca1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:19.489197 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-39d52f7a-ec86-4f27-8407-81778e88ca1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:19.496046 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d52f7a-ec86-4f27-8407-81778e88ca1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:19.496845 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d52f7a-ec86-4f27-8407-81778e88ca1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:19.497482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d52f7a-ec86-4f27-8407-81778e88ca1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:19.498428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d52f7a-ec86-4f27-8407-81778e88ca1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:19.499114 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d52f7a-ec86-4f27-8407-81778e88ca1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:19.499888 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d52f7a-ec86-4f27-8407-81778e88ca1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:19.622328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-39d52f7a-ec86-4f27-8407-81778e88ca1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.140527 Aug 10 11:15:19.622943 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 137/283] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 10 11:15:19 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:15:19.755346 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:19.767492 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-630a5d77-02c9-42cf-933e-dccc4729b5f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.309581 Aug 10 11:15:19.770082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 147/284] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:19 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:20.792070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:20.792730 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:20.811283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:20.820209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:20.820666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:20.821413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:20.821868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:20.822440 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:20.949569 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-7ab1a267-8e44-440f-82e1-8dd786946117 req-0a43ac13-3005-4c82-a6e6-30cd0b1793ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee85970-24fd-4e03-9c90-460c66ab82e9", "tag": "7396eb48-6699-42c7-8c7f-8122d6c9707a"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:20.970876 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-7ab1a267-8e44-440f-82e1-8dd786946117 req-0a43ac13-3005-4c82-a6e6-30cd0b1793ed service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:20.973952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-7ab1a267-8e44-440f-82e1-8dd786946117 req-0a43ac13-3005-4c82-a6e6-30cd0b1793ed service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:20.974442 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-7ab1a267-8e44-440f-82e1-8dd786946117 req-0a43ac13-3005-4c82-a6e6-30cd0b1793ed service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:21.015822 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-7ab1a267-8e44-440f-82e1-8dd786946117 req-0a43ac13-3005-4c82-a6e6-30cd0b1793ed service nova] Creating event network-changed:7396eb48-6699-42c7-8c7f-8122d6c9707a for instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 on hv-cinder-85272 Aug 10 11:15:21.028711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-7ab1a267-8e44-440f-82e1-8dd786946117 req-0a43ac13-3005-4c82-a6e6-30cd0b1793ed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083390 Aug 10 11:15:21.029742 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 148/285] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:21.186377 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:21.198708 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82d64f74-c409-4ee6-8792-7aed76dca582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.411904 Aug 10 11:15:21.203610 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 138/286] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:20 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:22.225072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:22.225852 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:22.232509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:22.232989 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:22.233424 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:22.234113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:22.234564 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:22.235016 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:22.384305 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:22.392190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a7569681-90ee-47b0-baad-8dea925c5940 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.171897 Aug 10 11:15:22.392993 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 149/287] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:22 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:23.414074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:23.414629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:23.420509 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:23.420984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:23.421420 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:23.422094 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:23.422538 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:23.422978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:23.559722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:23.567154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cddd8f4f-8071-4b79-80ec-f184e249988f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.157054 Aug 10 11:15:23.567734 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 139/288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:23 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:24.587859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:24.588877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:24.595449 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:24.595933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:24.596367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:24.597048 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:24.597496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:24.597917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:24.733990 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:24.741403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-77b0907f-dd21-4a87-a5ce-8cc24103ef76 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.157467 Aug 10 11:15:24.741967 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 150/289] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:24 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:25.761968 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:25.762594 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:25.768725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:25.769209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:25.769670 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:25.770363 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:25.770847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:25.771268 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:25.900063 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:25.904259 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:25.909356 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-25ad24df-e3d7-4cb5-a332-bc1ee9dea361 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.151274 Aug 10 11:15:25.909926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 140/290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:25 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:26.930545 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:26.931119 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:26.934307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:26.939710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:26.940199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:26.940640 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:26.941347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:26.941806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:26.942233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:27.071899 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:27.079826 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d3a6762a-d8c3-4999-9cb4-51cf5dd72bd9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.153280 Aug 10 11:15:27.080383 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 151/291] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:26 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:28.101213 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:28.101845 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:28.108515 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:28.108994 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:28.109456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:28.110195 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:28.110763 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:28.111194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:28.311966 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:28.323050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2b06c718-c41f-4722-860c-540ec85ac4d4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.223532 Aug 10 11:15:28.333375 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 141/292] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:28 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:29.344652 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:29.345553 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:29.348063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:29.353860 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:29.354350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:29.354820 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:29.355527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:29.356008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:29.356416 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:29.489448 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:29.497090 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ce63ea75-058f-4312-9a93-03c80a37722d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1500 microversion: 2.1 time: 0.156387 Aug 10 11:15:29.497588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 152/293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:29 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:29.517737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8627fce3-3681-49d8-9129-0938d6fa2bd9"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:29.520036 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:29.532428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:29.533173 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:29.533701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:29.535353 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:29.536219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:29.536604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:29.562708 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] HTTP exception thrown: Cannot 'attach_volume' instance 265d9c1c-b86e-449c-a651-b8bc81225a88 while it is in vm_state rescued Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Request method failure captured: Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88/os-volume_attachments HTTP/1.1 Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 74 Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85K2E2Wrim3-FxJMDYkkzQ_TMt5XzYbkWrEXOnPp9f0n4bCiKVg5CauNkfwdqiV0X33kGX_Mxw_UEozhsObEyrl7sEgn5MXwNG1VgK0TxGl-tvYd7MgLVE2Sx7DPXAFidcuR5kUzdLm67tAihNIGsOEgKSQHtJi9BHRYLOrW4INPUEk Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:15:29.564903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 5d1368fb915444b599b3fcf3f5586789 Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {"volumeAttachment": {"volumeId": "8627fce3-3681-49d8-9129-0938d6fa2bd9"}} Aug 10 11:15:29.566464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Cannot 'attach_volume' instance 265d9c1c-b86e-449c-a651-b8bc81225a88 while it is in vm_state rescued Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '265d9c1c-b86e-449c-a651-b8bc81225a88', 'body': {'volumeAttachment': {'volumeId': '8627fce3-3681-49d8-9129-0938d6fa2bd9'}}} Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 265d9c1c-b86e-449c-a651-b8bc81225a88 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:15:29.567274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 265d9c1c-b86e-449c-a651-b8bc81225a88 while it is in vm_state rescued Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:15:29.568458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:15:29.569557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:15:29.569557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:15:29.569557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 265d9c1c-b86e-449c-a651-b8bc81225a88 while it is in vm_state rescued Aug 10 11:15:29.569557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:15:29.569557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Returning 409 to user: Cannot 'attach_volume' instance 265d9c1c-b86e-449c-a651-b8bc81225a88 while it is in vm_state rescued {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:15:29.569557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-570ec5aa-9cb4-4d45-9b9a-4036f6d9c736 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052582 Aug 10 11:15:29.569557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 142/294] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:15:29 2022] POST /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 11:15:29.575637 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c4e26927-b352-422b-9197-4c58d479a673 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:29.576191 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c4e26927-b352-422b-9197-4c58d479a673 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:29.582058 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4e26927-b352-422b-9197-4c58d479a673 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:29.582542 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4e26927-b352-422b-9197-4c58d479a673 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:29.583034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4e26927-b352-422b-9197-4c58d479a673 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:29.583714 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4e26927-b352-422b-9197-4c58d479a673 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:29.584163 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4e26927-b352-422b-9197-4c58d479a673 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:29.584584 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4e26927-b352-422b-9197-4c58d479a673 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:29.653988 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c4e26927-b352-422b-9197-4c58d479a673 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88/action" status: 202 len: 0 microversion: 2.1 time: 0.081754 Aug 10 11:15:29.654683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 153/295] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:15:29 2022] POST /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:15:29.662952 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:29.663596 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:29.670081 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:29.670735 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:29.671178 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:29.672089 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:29.672360 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:29.672787 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:29.809469 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:29.821328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-355e57a4-1720-4e20-b327-749e51af16a3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.162345 Aug 10 11:15:29.822150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 143/296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:29 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:30.844640 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:30.845380 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:30.851709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:30.852225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:30.852668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:30.853363 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:30.854311 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:30.854768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:30.983785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:30.991209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6c251461-6041-4f48-8398-8f2ea3ad861f tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.151239 Aug 10 11:15:30.991769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 154/297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:30 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:32.012492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:32.013102 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:32.018996 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:32.019483 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:32.019915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:32.020606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:32.021059 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:32.021485 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:32.147539 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:32.155374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a4658afa-31e2-4c3a-a35d-d9b5be8e2af1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.147233 Aug 10 11:15:32.156080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 144/298] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:32 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:33.176195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:33.176812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:33.187518 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:33.187518 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:33.187518 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:33.187518 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:33.187895 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:33.187895 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:33.320222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:33.322270 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:33.329274 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b0e6ab7d-ea83-4f13-8252-637b44a7add9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.157168 Aug 10 11:15:33.329843 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 155/299] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:33 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:34.350317 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:34.350949 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:34.352827 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:34.358705 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:34.359189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:34.359624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:34.360310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:34.360761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:34.361180 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:34.487207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:34.494624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6c485bfd-245d-4bb7-9d06-7aeeb93e2391 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.148150 Aug 10 11:15:34.495189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 145/300] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:34 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:35.516113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:35.516643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:35.523490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:35.523965 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:35.524390 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:35.525067 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:35.526113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:35.526532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:35.661570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:35.669765 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f4205fcd-c48c-41ac-a8a9-c62fb1af4001 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.157829 Aug 10 11:15:35.670326 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 156/301] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:35 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:36.690527 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:36.691285 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:36.697264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:36.698411 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:36.698876 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:36.699567 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:36.700023 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:36.700448 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:36.823725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:36.831174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b6aff9e2-d7d4-49bc-a35a-becaed4449a0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.144528 Aug 10 11:15:36.831741 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 146/302] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:36 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:37.851428 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:37.852072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:37.859172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:37.859650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:37.860089 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:37.860786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:37.861239 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:37.861663 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:37.988383 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:37.995810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8503633a-5619-4764-9b07-92d73413bf8e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.148248 Aug 10 11:15:37.996363 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 157/303] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:37 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:39.017292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:39.017861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:39.023707 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:39.024184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:39.024612 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:39.025288 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:39.026407 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:39.026933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:39.159992 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:39.167569 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b4225d92-0c10-4072-ac30-5ecbbaed0271 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.154187 Aug 10 11:15:39.168127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 147/304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:39 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:40.189277 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:40.189859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:40.196334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:40.196808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:40.197238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:40.197923 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:40.198370 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:40.198814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:40.338694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:40.346138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0f8ba415-3776-426f-aa6a-1aafc468b4b3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.160930 Aug 10 11:15:40.346728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 158/305] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:40 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:41.367284 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:41.372238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:41.376754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:41.377283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:41.377657 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:41.378443 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:41.378818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:41.384847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:41.531526 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:41.539573 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1690c0b2-3115-4574-a5a2-026cae2bdc54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1508 microversion: 2.1 time: 0.176061 Aug 10 11:15:41.540387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 148/306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:41 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:42.563397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:42.564112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:42.571403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:42.571907 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:42.572365 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:42.573080 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:42.573532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:42.573964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:42.712626 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:42.721009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ab735002-3c2e-4b11-a1bb-4333fc4e1e88 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1514 microversion: 2.1 time: 0.161467 Aug 10 11:15:42.721676 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 159/307] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:42 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:45.228138 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85bef222-3e20-4c89-a866-86306b016e23 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'create', calling method: .version_select at 0x7fccf82b9a60>, body: {"keypair": {"name": "tempest-keypair-1224403454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcsDK422WesUpyIs3l83Dzg0DZ88Sh0rZIjiBum24o0Ele00sq0QXXhqxtbmsWtsx/oELR9nXWDoG7eij6DU7EEbQcddijVXtgwvmjl/vDyAC1O8bUXMkND0cH99IHYg=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:45.244310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-85bef222-3e20-4c89-a866-86306b016e23 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Getting quotas for project 429a80ecb8464ef3ad67a23a06fc10f7. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:15:45.248940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-85bef222-3e20-4c89-a866-86306b016e23 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Getting quotas for user 5d1368fb915444b599b3fcf3f5586789 and project 429a80ecb8464ef3ad67a23a06fc10f7. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:15:45.271320 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85bef222-3e20-4c89-a866-86306b016e23 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047425 Aug 10 11:15:45.272166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 149/308] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:15:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:46.662835 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1170381865", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49acdff1-cbf0-4921-a092-bf7cdfa7544c"}], "security_groups": [{"name": "tempest-securitygroup--32855132"}], "key_name": "tempest-keypair-1224403454", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:46.790029 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] validate_networks() for [('49acdff1-cbf0-4921-a092-bf7cdfa7544c', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:15:47.374814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:15:47.375445 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:15:47.375930 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:15:47.376551 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:15:47.377022 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:15:47.386565 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:47.387089 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:47.387527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:47.388764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:47.389247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:47.389869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:47.408159 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Getting quotas for project 429a80ecb8464ef3ad67a23a06fc10f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:15:47.417698 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Getting quotas for user 5d1368fb915444b599b3fcf3f5586789 and project 429a80ecb8464ef3ad67a23a06fc10f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:15:47.430262 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:15:47.433757 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:15:47.486638 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-89be3a66-be64-462f-a0e5-30749c16ecb8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.828053 Aug 10 11:15:47.487710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 160/309] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:15:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:15:47.499058 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-67172eb2-d098-4f58-9c3f-aebe5e8ab188 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:47.499674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-67172eb2-d098-4f58-9c3f-aebe5e8ab188 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:47.563909 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67172eb2-d098-4f58-9c3f-aebe5e8ab188 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:47.571301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-67172eb2-d098-4f58-9c3f-aebe5e8ab188 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1246 microversion: 2.1 time: 0.076874 Aug 10 11:15:47.571975 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 150/310] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:47 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:48.592139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:48.592751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:48.599388 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:48.599875 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:48.600346 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:48.601043 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:48.601502 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:48.601930 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:48.664943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:48.673090 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-752b908a-caa5-4751-affb-26818c0c6f22 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1250 microversion: 2.1 time: 0.085332 Aug 10 11:15:48.673655 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 161/311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:48 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:49.694112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:49.694763 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:49.701667 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:49.702149 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:49.702602 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:49.703289 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:49.703744 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:49.704171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:49.763820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:49.771500 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e76b700d-0043-4b76-83f4-7373f8cca172 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1250 microversion: 2.1 time: 0.081217 Aug 10 11:15:49.772067 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 151/312] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:49 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:50.792125 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:50.792731 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:50.799704 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:50.800184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:50.800616 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:50.801307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:50.801757 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:50.802179 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:50.861319 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:50.868806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-37bfe389-912c-427a-883b-2172745bbea4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1250 microversion: 2.1 time: 0.080525 Aug 10 11:15:50.869367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 162/313] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:50 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:51.889519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:51.890073 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:51.896191 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:51.896684 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:51.897178 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:51.897872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:51.898350 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:51.898798 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:51.957639 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:51.964929 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-354487f7-d96f-45d9-8a74-6d798834424d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1250 microversion: 2.1 time: 0.079886 Aug 10 11:15:51.965496 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 152/314] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:51 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:52.986663 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:52.987285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:52.994264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:52.994780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:52.995222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:52.995921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:52.996375 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:52.996805 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:53.063940 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:53.072257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cd80e5b8-eef7-4179-bdee-4612687842a1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1298 microversion: 2.1 time: 0.089485 Aug 10 11:15:53.072814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 163/315] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:52 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:54.094030 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:54.095149 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:54.102101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:54.102794 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:54.103338 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:54.104253 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:54.104820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:54.105612 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:54.344249 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:54.351713 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-637e1bf0-7df1-4f3a-87a8-a2bb045b039d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.261965 Aug 10 11:15:54.352275 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 153/316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:54 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:54.651154 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-e9ce17a7-595e-4675-88fa-4533cc9af05b req-63cc63ee-ab64-4a86-a221-18cb8bd96958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6452d7fb-2373-409c-81fe-2c67626068ae", "tag": "915bfc88-7f55-43d7-b302-6e13fb3394a5"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:54.662174 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e9ce17a7-595e-4675-88fa-4533cc9af05b req-63cc63ee-ab64-4a86-a221-18cb8bd96958 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:54.662679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e9ce17a7-595e-4675-88fa-4533cc9af05b req-63cc63ee-ab64-4a86-a221-18cb8bd96958 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:54.663110 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e9ce17a7-595e-4675-88fa-4533cc9af05b req-63cc63ee-ab64-4a86-a221-18cb8bd96958 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:54.674978 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-e9ce17a7-595e-4675-88fa-4533cc9af05b req-63cc63ee-ab64-4a86-a221-18cb8bd96958 service nova] Creating event network-changed:915bfc88-7f55-43d7-b302-6e13fb3394a5 for instance 6452d7fb-2373-409c-81fe-2c67626068ae on hv-cinder-85272 Aug 10 11:15:54.679916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-e9ce17a7-595e-4675-88fa-4533cc9af05b req-63cc63ee-ab64-4a86-a221-18cb8bd96958 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032653 Aug 10 11:15:54.680511 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 164/317] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:55.371902 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:55.372510 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:55.378843 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:55.379522 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:55.379960 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:55.380655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:55.381105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:55.381528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:55.514599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:55.522813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-47c6e146-6aa7-4d33-9219-98f3120c7619 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.154792 Aug 10 11:15:55.523366 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 154/318] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:55 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:56.544637 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:56.545421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:56.551674 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:56.552158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:56.552588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:56.553276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:56.553726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:56.554361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:56.685193 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:56.692577 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f8ff54b6-0d0f-49dc-bdd5-7bd71160b761 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.152556 Aug 10 11:15:56.693137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 165/319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:56 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:57.713583 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:57.714220 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:57.716948 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:57.723165 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:57.723403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:57.723951 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:57.724795 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:57.725491 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:57.725926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:57.873139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:57.881639 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16b42fcf-d355-42c4-a86b-ab9355375582 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.172035 Aug 10 11:15:57.882212 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 155/320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:57 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:58.902756 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:58.903307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:15:58.905250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:58.906066 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:58.907023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:58.913156 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:58.913641 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:58.914079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:58.914797 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:15:58.915251 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:15:58.915674 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:15:59.040887 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:15:59.048138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4bb482eb-1303-44cf-86e3-bec5ea77048e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.149341 Aug 10 11:15:59.048688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 166/321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:15:58 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:00.069228 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:00.070774 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:00.077533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:00.078015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:00.078441 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:00.079230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:00.079845 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:00.080267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:00.086143 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=77 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:00.288017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:00.295515 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-257f5cd8-f578-42f2-afa6-fe1a9a148676 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.230376 Aug 10 11:16:00.296077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 156/322] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:00 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:01.315550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:01.316161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:01.322566 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:01.323079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:01.323515 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:01.324212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:01.324668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:01.325101 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:01.462014 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:01.469337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-69f4396a-0249-4085-9481-66bd1a2fb600 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.157651 Aug 10 11:16:01.469877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 167/323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:01 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:02.489857 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:02.490456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:02.505868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:02.506403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:02.506897 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:02.507612 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:02.508104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:02.508526 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:02.640278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:02.648101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-936000b8-0fa1-4bf0-8153-8069a5ca129c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.162080 Aug 10 11:16:02.648679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 157/324] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:02 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:03.669747 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:03.670402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:03.676862 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:03.677378 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:03.677820 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:03.678514 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:03.679011 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:03.679439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:03.809331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:03.817606 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8392736b-dad4-4d84-bb27-d66ef9e44296 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.152246 Aug 10 11:16:03.818172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 168/325] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:03 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:04.837773 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:04.838375 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:04.840237 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:04.845324 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:04.845814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:04.846248 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:04.846980 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:04.847452 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:04.847862 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:04.973804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:04.981090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aff3ed4a-fb0a-4b4e-a7b4-c1dadd3e8dea tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.147150 Aug 10 11:16:04.981699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 158/326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:04 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:06.001509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:06.002118 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:06.008070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:06.008548 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:06.008981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:06.009673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:06.010126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:06.010550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:06.013090 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=72 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:06.137970 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:06.145539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-813454c6-3d25-44a2-9feb-169cc416b899 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.148711 Aug 10 11:16:06.146100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 169/327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:05 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:07.165769 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:07.166378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:07.172995 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:07.173473 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:07.173899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:07.174968 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:07.175419 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:07.175838 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:07.302890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:07.310492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8e76aee7-618b-4543-bca6-4dffdbb818e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.148514 Aug 10 11:16:07.311083 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 159/328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:07 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:08.332361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:08.333000 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:08.338874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:08.339357 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:08.339794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:08.340497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:08.341624 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:08.342031 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:08.496787 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:08.504959 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8135d18a-a6a2-4883-bf3d-62d4d0e497e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.177246 Aug 10 11:16:08.505536 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 170/329] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:08 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:08.578665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-3ae1cfbd-270d-4f0c-80bf-1151625cffd9 req-19903980-c0b2-4f33-b429-6360891ec419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6452d7fb-2373-409c-81fe-2c67626068ae", "name": "network-vif-plugged", "status": "completed", "tag": "915bfc88-7f55-43d7-b302-6e13fb3394a5"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:08.588715 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3ae1cfbd-270d-4f0c-80bf-1151625cffd9 req-19903980-c0b2-4f33-b429-6360891ec419 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:08.589194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3ae1cfbd-270d-4f0c-80bf-1151625cffd9 req-19903980-c0b2-4f33-b429-6360891ec419 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:08.589821 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3ae1cfbd-270d-4f0c-80bf-1151625cffd9 req-19903980-c0b2-4f33-b429-6360891ec419 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:08.601121 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-3ae1cfbd-270d-4f0c-80bf-1151625cffd9 req-19903980-c0b2-4f33-b429-6360891ec419 service nova] Creating event network-vif-plugged:915bfc88-7f55-43d7-b302-6e13fb3394a5 for instance 6452d7fb-2373-409c-81fe-2c67626068ae on hv-cinder-85272 Aug 10 11:16:08.606344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-3ae1cfbd-270d-4f0c-80bf-1151625cffd9 req-19903980-c0b2-4f33-b429-6360891ec419 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031871 Aug 10 11:16:08.607166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 160/330] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:09.524906 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:09.525513 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:09.532610 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:09.533092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:09.533529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:09.534216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:09.534700 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:09.535124 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:09.660321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:09.667811 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-62cc588b-6f11-43a3-8609-baa0593f4b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.146670 Aug 10 11:16:09.668380 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 171/331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:09 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:10.689216 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:10.689827 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:10.696258 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:10.696732 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:10.697157 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:10.697834 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:10.698287 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:10.698736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:10.854315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:10.863012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8cf3f5f9-ec2c-41a8-867b-55adc7e7a759 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.177850 Aug 10 11:16:10.875259 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 161/332] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:10 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:11.882909 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:11.883528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:11.890685 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:11.891168 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:11.891599 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:11.892286 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:11.892739 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:11.893156 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:12.019682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:12.026949 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c2b3ca7d-31cc-4c24-9ec9-e46f2ef957d8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1370 microversion: 2.1 time: 0.147991 Aug 10 11:16:12.027508 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 172/333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:11 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:13.047504 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:13.048106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:13.053923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:13.054402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:13.054860 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:13.055548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:13.055994 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:13.056413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:13.185793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:13.193705 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f035cc04-f9d5-4346-a920-26125cb6c800 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1563 microversion: 2.1 time: 0.150041 Aug 10 11:16:13.194258 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 162/334] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:13 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:13.214293 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-882311b5-f1d3-4f62-aef9-7e3124d34ce8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:13.214851 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-882311b5-f1d3-4f62-aef9-7e3124d34ce8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:13.221186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-882311b5-f1d3-4f62-aef9-7e3124d34ce8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:13.221671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-882311b5-f1d3-4f62-aef9-7e3124d34ce8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:13.222108 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-882311b5-f1d3-4f62-aef9-7e3124d34ce8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:13.222832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-882311b5-f1d3-4f62-aef9-7e3124d34ce8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:13.223292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-882311b5-f1d3-4f62-aef9-7e3124d34ce8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:13.223720 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-882311b5-f1d3-4f62-aef9-7e3124d34ce8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:13.299470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-882311b5-f1d3-4f62-aef9-7e3124d34ce8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088998 Aug 10 11:16:13.300070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 173/335] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 11:16:13 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:16:14.201244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a0a7cc08-2b75-4db8-a1d3-3434b412c667 req-50a593e0-8e11-4dcd-b0e6-d2372480373e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6452d7fb-2373-409c-81fe-2c67626068ae", "tag": "915bfc88-7f55-43d7-b302-6e13fb3394a5"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:14.210802 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a0a7cc08-2b75-4db8-a1d3-3434b412c667 req-50a593e0-8e11-4dcd-b0e6-d2372480373e service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:14.211176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a0a7cc08-2b75-4db8-a1d3-3434b412c667 req-50a593e0-8e11-4dcd-b0e6-d2372480373e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:14.211604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a0a7cc08-2b75-4db8-a1d3-3434b412c667 req-50a593e0-8e11-4dcd-b0e6-d2372480373e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:14.233877 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a0a7cc08-2b75-4db8-a1d3-3434b412c667 req-50a593e0-8e11-4dcd-b0e6-d2372480373e service nova] Creating event network-changed:915bfc88-7f55-43d7-b302-6e13fb3394a5 for instance 6452d7fb-2373-409c-81fe-2c67626068ae on hv-cinder-85272 Aug 10 11:16:14.239158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a0a7cc08-2b75-4db8-a1d3-3434b412c667 req-50a593e0-8e11-4dcd-b0e6-d2372480373e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042004 Aug 10 11:16:14.239764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 163/336] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:19.014548 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1787386337", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800106665", "security_groups": [{"name": "tempest-secgroup-smoke-874089438"}], "block_device_mapping_v2": [{"uuid": "edcf5b47-0958-4fa6-baf0-0d7c688e4145", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6731bf27-4e34-48cb-9d42-c4bbb5a3efbd"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:19.134542 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] validate_networks() for [('6731bf27-4e34-48cb-9d42-c4bbb5a3efbd', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:16:19.497786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:16:19.498203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:16:19.498737 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:16:19.499145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:16:19.499549 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:16:19.508237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:19.508710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:19.509140 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:19.509853 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:19.510302 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:19.510759 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:19.527615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Getting quotas for project 79389800e0ea49d3b5abfbefe17960ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:16:19.531502 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Getting quotas for user 7ebc052a3cb6400a961c1b9d9bec83d6 and project 79389800e0ea49d3b5abfbefe17960ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:16:19.587429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:16:19.589552 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edcf5b47-0958-4fa6-baf0-0d7c688e4145',volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:16:19.743589 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-56edf146-729e-4dc8-92f1-2d9b476e457c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.730459 Aug 10 11:16:19.746857 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 174/337] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:16:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:16:19.757167 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2a2f8217-b1e3-41f0-80a5-fa94c6fc61cc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:19.757697 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2a2f8217-b1e3-41f0-80a5-fa94c6fc61cc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:19.816070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a2f8217-b1e3-41f0-80a5-fa94c6fc61cc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:19.823601 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2a2f8217-b1e3-41f0-80a5-fa94c6fc61cc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1094 microversion: 2.1 time: 0.074981 Aug 10 11:16:19.824174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 164/338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:19 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:20.849898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:20.850510 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:20.858169 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:20.858698 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:20.859136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:20.859838 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:20.860296 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:20.860758 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:20.925734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:20.933412 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c201b2e9-560f-4efe-85d7-4b44fff622e6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1192 microversion: 2.1 time: 0.087771 Aug 10 11:16:20.933978 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 175/339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:20 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:21.958414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:21.959624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:21.970770 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:21.972214 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:21.974445 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:21.975976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:21.978999 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:21.980133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:22.065134 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:22.079078 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d8669df3-aa3c-4149-8146-7a0d96dac978 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1210 microversion: 2.1 time: 0.126132 Aug 10 11:16:22.084199 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 165/340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:21 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:22.992911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-80cf7624-9544-4d9f-adc4-5ed38eba9f5d req-aafb39bc-206f-4bdc-b0cb-37f1a141f042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628a87c3-fd0c-4dc9-928d-f3101ca70218", "tag": "ca4e73e3-0761-49f5-89f4-b0d8ef602d71"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:23.004259 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-80cf7624-9544-4d9f-adc4-5ed38eba9f5d req-aafb39bc-206f-4bdc-b0cb-37f1a141f042 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:23.004827 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-80cf7624-9544-4d9f-adc4-5ed38eba9f5d req-aafb39bc-206f-4bdc-b0cb-37f1a141f042 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:23.005472 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-80cf7624-9544-4d9f-adc4-5ed38eba9f5d req-aafb39bc-206f-4bdc-b0cb-37f1a141f042 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:23.018241 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-80cf7624-9544-4d9f-adc4-5ed38eba9f5d req-aafb39bc-206f-4bdc-b0cb-37f1a141f042 service nova] Creating event network-changed:ca4e73e3-0761-49f5-89f4-b0d8ef602d71 for instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 on hv-cinder-85272 Aug 10 11:16:23.023187 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-80cf7624-9544-4d9f-adc4-5ed38eba9f5d req-aafb39bc-206f-4bdc-b0cb-37f1a141f042 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034207 Aug 10 11:16:23.023800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 176/341] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:23.103454 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:23.103454 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:23.110807 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:23.111570 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:23.111839 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:23.112724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:23.113250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:23.113876 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:23.525629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:23.533955 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-21d58edf-0b4c-4bc6-ac27-94945fddbc77 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.437364 Aug 10 11:16:23.534520 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 166/342] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:23 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:24.556476 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:24.557094 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:24.563529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:24.564016 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:24.564451 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:24.565138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:24.565588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:24.566011 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:24.703641 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:24.711109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d9a2bae9-bf46-42d7-a838-1459ee548fed tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.159321 Aug 10 11:16:24.711667 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 177/343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:24 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:25.731152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:25.732266 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:25.738114 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:25.738595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:25.739045 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:25.739725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:25.740168 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:25.740582 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:25.878885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:25.886216 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-686137db-bf08-47c7-aca6-37153775ba27 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.158951 Aug 10 11:16:25.886793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 167/344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:25 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:26.907584 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:26.908196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:26.914677 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:26.915021 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:26.915453 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:26.916144 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:26.916595 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:26.917019 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:27.052138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:27.060379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e97949f4-2a15-4749-8564-67b889390661 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.156674 Aug 10 11:16:27.060934 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 178/345] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:26 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:28.080745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:28.081364 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:28.087240 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:28.087721 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:28.088146 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:28.088869 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:28.089321 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:28.089776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:28.221067 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:28.228644 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-28f0aac2-9f2a-49a2-ad53-1b3cc103984c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.151736 Aug 10 11:16:28.229208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 168/346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:28 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:29.249693 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:29.250231 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:29.252608 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:29.257689 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:29.258166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:29.258615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:29.259298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:29.259746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:29.260163 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:29.399521 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:29.406997 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-02e226c4-3e45-4db7-a410-714f7b54d905 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.161593 Aug 10 11:16:29.407639 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 179/347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:29 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:30.428221 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:30.428830 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:30.430856 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:30.437189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:30.437672 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:30.438106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:30.438820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:30.439272 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:30.439698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:30.443704 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=64 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:30.569819 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:30.577213 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-baac6639-0754-4600-876b-62f286899f61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.152937 Aug 10 11:16:30.577777 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 169/348] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:30 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:31.597756 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:31.598354 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:31.600374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:31.601043 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:31.608450 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:31.608950 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:31.609394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:31.610100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:31.610555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:31.611010 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:31.748704 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:31.756157 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-369ae916-aef7-4d35-be4c-df9193f01aae tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.162295 Aug 10 11:16:31.756722 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 180/349] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:31 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:32.776668 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:32.777316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:32.784053 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:32.784539 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:32.784976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:32.785670 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:32.786121 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:32.786541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:32.918374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:32.926824 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c8f49f71-e5aa-4b65-a4b4-73a9280c48c9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.153972 Aug 10 11:16:32.927395 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 170/350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:32 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:33.946900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:33.947503 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:33.956108 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:33.956838 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:33.957489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:33.958534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:33.959337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:33.960085 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:34.095842 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:34.103230 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fda202a7-79bd-4c17-bc99-26a09d6afcea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.160162 Aug 10 11:16:34.103788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 181/351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:33 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:35.123309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:35.123912 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:35.125747 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=28 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:35.130947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:35.131418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:35.131844 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:35.132520 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:35.132972 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:35.133676 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:35.260224 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:35.267596 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7cffbb25-ad96-4eb3-b60b-96cfe011bddc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.148161 Aug 10 11:16:35.268159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 171/352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:35 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:36.288443 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:36.289044 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:36.295577 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:36.296051 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:36.296498 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:36.297164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:36.297609 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:36.298022 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:36.304362 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=68 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:36.439719 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:36.447173 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1f92aab9-4ec8-44bc-9d6b-39d5ca0269e1 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.162708 Aug 10 11:16:36.447734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 182/353] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:36 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:36.842535 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c127135b-db6e-440e-94b7-1727ffbf2f85 req-d27a0a29-7944-473f-89d7-284b0536ede6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628a87c3-fd0c-4dc9-928d-f3101ca70218", "name": "network-vif-plugged", "status": "completed", "tag": "ca4e73e3-0761-49f5-89f4-b0d8ef602d71"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:36.852746 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c127135b-db6e-440e-94b7-1727ffbf2f85 req-d27a0a29-7944-473f-89d7-284b0536ede6 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:36.853230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c127135b-db6e-440e-94b7-1727ffbf2f85 req-d27a0a29-7944-473f-89d7-284b0536ede6 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:36.853675 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c127135b-db6e-440e-94b7-1727ffbf2f85 req-d27a0a29-7944-473f-89d7-284b0536ede6 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:36.867423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c127135b-db6e-440e-94b7-1727ffbf2f85 req-d27a0a29-7944-473f-89d7-284b0536ede6 service nova] Creating event network-vif-plugged:ca4e73e3-0761-49f5-89f4-b0d8ef602d71 for instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 on hv-cinder-85272 Aug 10 11:16:36.872735 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c127135b-db6e-440e-94b7-1727ffbf2f85 req-d27a0a29-7944-473f-89d7-284b0536ede6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033285 Aug 10 11:16:36.873335 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 172/354] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:37.468323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:37.468922 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:37.475235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:37.475714 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:37.476141 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:37.476820 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:37.477268 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:37.477687 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:37.603484 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:37.610730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3d65854a-6d2c-4a22-b9bc-1bca84797a86 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.146710 Aug 10 11:16:37.611575 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 183/355] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:37 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:38.632378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:38.633004 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:38.639170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:38.639653 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:38.640086 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:38.640774 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:38.641229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:38.641657 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:38.773393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:38.781416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-939a2ead-46b7-435a-a499-e76d9461ebf2 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1265 microversion: 2.1 time: 0.153302 Aug 10 11:16:38.781974 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 173/356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:38 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:39.802416 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:39.803001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:39.810140 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:39.810640 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:39.811072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:39.811750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:39.812198 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:39.812648 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:39.941010 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:39.948420 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c1eae703-687d-4176-b32a-616dcb73710d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1451 microversion: 2.1 time: 0.149985 Aug 10 11:16:39.949010 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 184/357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:39 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:39.968881 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:39.969486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:39.976557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:39.977049 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:39.977515 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:39.978211 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:39.978699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:39.979127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:40.105744 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:16:40.113871 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-60f1aed5-dc61-4e36-8133-5579096194ea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1451 microversion: 2.1 time: 0.149282 Aug 10 11:16:40.114434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 174/358] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:16:39 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:41.997900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-0aceca61-950b-459c-919a-140d30fd87b0 req-c82c97fc-0a26-41e1-a577-00e1ca857a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628a87c3-fd0c-4dc9-928d-f3101ca70218", "tag": "ca4e73e3-0761-49f5-89f4-b0d8ef602d71"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:42.011493 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-0aceca61-950b-459c-919a-140d30fd87b0 req-c82c97fc-0a26-41e1-a577-00e1ca857a64 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:42.012353 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-0aceca61-950b-459c-919a-140d30fd87b0 req-c82c97fc-0a26-41e1-a577-00e1ca857a64 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:42.012903 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-0aceca61-950b-459c-919a-140d30fd87b0 req-c82c97fc-0a26-41e1-a577-00e1ca857a64 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:42.027101 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-0aceca61-950b-459c-919a-140d30fd87b0 req-c82c97fc-0a26-41e1-a577-00e1ca857a64 service nova] Creating event network-changed:ca4e73e3-0761-49f5-89f4-b0d8ef602d71 for instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 on hv-cinder-85272 Aug 10 11:16:42.032565 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-0aceca61-950b-459c-919a-140d30fd87b0 req-c82c97fc-0a26-41e1-a577-00e1ca857a64 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038934 Aug 10 11:16:42.033431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 185/359] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:59.055071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7d3214c-6286-4b6b-9bf9-b9b62258a369 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:59.055610 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a7d3214c-6286-4b6b-9bf9-b9b62258a369 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:16:59.057576 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:59.058263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=31 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:59.064353 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7d3214c-6286-4b6b-9bf9-b9b62258a369 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:59.064840 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7d3214c-6286-4b6b-9bf9-b9b62258a369 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:59.065281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7d3214c-6286-4b6b-9bf9-b9b62258a369 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:59.065975 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7d3214c-6286-4b6b-9bf9-b9b62258a369 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:16:59.066436 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7d3214c-6286-4b6b-9bf9-b9b62258a369 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:16:59.066898 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7d3214c-6286-4b6b-9bf9-b9b62258a369 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:16:59.089837 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a7d3214c-6286-4b6b-9bf9-b9b62258a369 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/ips" status: 200 len: 145 microversion: 2.1 time: 0.038640 Aug 10 11:16:59.090388 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 175/360] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:16:59 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:00.655500 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=13 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:00.656167 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=19 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:00.661195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b5206900-8268-4b45-adae-e8280ae8fbdd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:00.661781 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b5206900-8268-4b45-adae-e8280ae8fbdd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:00.668543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5206900-8268-4b45-adae-e8280ae8fbdd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:00.669026 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5206900-8268-4b45-adae-e8280ae8fbdd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:00.669456 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5206900-8268-4b45-adae-e8280ae8fbdd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:00.670143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5206900-8268-4b45-adae-e8280ae8fbdd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:00.670619 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5206900-8268-4b45-adae-e8280ae8fbdd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:00.671050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5206900-8268-4b45-adae-e8280ae8fbdd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:00.693651 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b5206900-8268-4b45-adae-e8280ae8fbdd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/ips" status: 200 len: 149 microversion: 2.1 time: 0.039780 Aug 10 11:17:00.694197 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 186/361] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:17:00 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:01.109421 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58a28ce8-8ce7-42c0-8aaf-006b175037f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "475eb65c-42ba-419b-aa2b-683bd3aeffe5"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:01.111798 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-58a28ce8-8ce7-42c0-8aaf-006b175037f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:01.117786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a28ce8-8ce7-42c0-8aaf-006b175037f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:01.118265 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a28ce8-8ce7-42c0-8aaf-006b175037f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:01.118737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a28ce8-8ce7-42c0-8aaf-006b175037f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:01.119426 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a28ce8-8ce7-42c0-8aaf-006b175037f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:01.119882 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a28ce8-8ce7-42c0-8aaf-006b175037f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:01.120310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a28ce8-8ce7-42c0-8aaf-006b175037f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:01.431966 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-58a28ce8-8ce7-42c0-8aaf-006b175037f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326360 Aug 10 11:17:01.435098 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 176/362] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:17:01 2022] POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:03.104977 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f62aaab0-c496-437f-8a16-3b2afe1a9bca tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:03.107335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f62aaab0-c496-437f-8a16-3b2afe1a9bca tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:03.114045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62aaab0-c496-437f-8a16-3b2afe1a9bca tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:03.114529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62aaab0-c496-437f-8a16-3b2afe1a9bca tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:03.115002 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62aaab0-c496-437f-8a16-3b2afe1a9bca tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:03.115699 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62aaab0-c496-437f-8a16-3b2afe1a9bca tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:03.116152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62aaab0-c496-437f-8a16-3b2afe1a9bca tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:03.116626 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62aaab0-c496-437f-8a16-3b2afe1a9bca tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:03.374176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f62aaab0-c496-437f-8a16-3b2afe1a9bca tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272964 Aug 10 11:17:03.374956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 187/363] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:17:03 2022] POST /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:10.012918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19eba12a-9316-4472-9644-aa70be2508fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:10.019775 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19eba12a-9316-4472-9644-aa70be2508fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:10.020257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19eba12a-9316-4472-9644-aa70be2508fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:10.020719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19eba12a-9316-4472-9644-aa70be2508fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:10.079281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19eba12a-9316-4472-9644-aa70be2508fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Going to try to stop instance {{(pid=117920) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 11:17:10.123886 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19eba12a-9316-4472-9644-aa70be2508fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/action" status: 202 len: 0 microversion: 2.1 time: 0.115619 Aug 10 11:17:10.124484 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 177/364] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:17:10 2022] POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:17:10.135127 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:10.135835 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:10.142687 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:10.143228 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:10.143671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:10.144470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:10.144922 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:10.145366 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:10.274318 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:10.283147 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3abe0864-c5b6-4809-a572-f615c71fecb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.152948 Aug 10 11:17:10.283708 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 188/365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:10 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:11.305721 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:11.306422 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:11.313892 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:11.314370 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:11.314843 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:11.315530 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:11.315982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:11.316405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:11.444244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:11.452116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-258a8102-f622-4e31-a647-a9db81ad10d1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.151088 Aug 10 11:17:11.452675 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 178/366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:11 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:12.473842 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:12.474474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:12.481030 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:12.481506 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:12.481936 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:12.482681 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:12.483129 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:12.483549 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:12.610610 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:12.618380 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-753032c9-4050-4e2e-b956-0acefe2a5390 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.148421 Aug 10 11:17:12.618963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 189/367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:12 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:13.640109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:13.640648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:13.647000 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:13.647482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:13.647919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:13.648608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:13.649061 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:13.649482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:13.776134 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:13.784417 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-67e5c20a-e141-4ba8-a0bb-6625ea6257fb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.148147 Aug 10 11:17:13.784980 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 179/368] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:13 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:14.806160 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:14.806790 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:14.813357 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:14.813830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:14.814264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:14.814973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:14.815424 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:14.815840 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:14.945728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:14.953984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-86ede921-7827-4d3f-9bc7-b324abd42258 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.151285 Aug 10 11:17:14.954535 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 190/369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:14 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:15.975416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:15.976021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:15.982339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:15.982846 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:15.983275 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:15.983956 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:15.984402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:15.985471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:16.126129 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:16.134170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0f6febbd-b314-4abd-a8d9-118b0f9a2c17 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.162573 Aug 10 11:17:16.134744 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 180/370] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:15 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:17.156461 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:17.157072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:17.163329 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:17.163813 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:17.164250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:17.164948 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:17.165404 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:17.165826 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:17.238687 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f709bde-cd28-4cbe-85eb-a8c56b6e7986 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: .version_select at 0x7fccf963c790>, body: {"keypair": {"name": "tempest-keypair-1343507743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6w7/zBD52tGfoqyPJ6lvUEiSEXga0XgHvauwkEw0EokZDeTqPfZEYY9LfQnY3TFB1JlEcL07EkGyUeiCaq5LZPNbVITOaOBPnJc/dulgNdgUCoBXjWbwOg6nT/2E4y4A=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:17.254346 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8f709bde-cd28-4cbe-85eb-a8c56b6e7986 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:17:17.258278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8f709bde-cd28-4cbe-85eb-a8c56b6e7986 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for user 0a30897a10d8467aa294f24954368a84 and project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:17:17.281267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f709bde-cd28-4cbe-85eb-a8c56b6e7986 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046994 Aug 10 11:17:17.282428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 181/371] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:17:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:17:17.298984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:17.306877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-34889160-f3d4-4c4d-9dce-288ae2fceffe tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.154117 Aug 10 11:17:17.307638 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 191/372] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:17 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:18.329372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:18.329921 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:18.336921 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:18.337456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:18.337905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:18.338805 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:18.339053 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:18.339478 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:18.485930 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:18.497119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-606ffc47-4005-4d24-baf1-f913f472ec68 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.171735 Aug 10 11:17:18.497686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 182/373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:18 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:18.529141 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-139632728", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7551c29-e5c9-4c19-8306-42621bf3d395"}], "security_groups": [{"name": "tempest-securitygroup--2117101005"}], "key_name": "tempest-keypair-1343507743", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:18.630595 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] validate_networks() for [('b7551c29-e5c9-4c19-8306-42621bf3d395', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:17:18.995470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:17:18.995891 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:17:18.996361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:17:18.996792 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:17:18.997199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:17:19.006139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:19.006711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:19.007195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:19.007996 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:19.008520 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:19.008991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:19.026241 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:17:19.030707 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for user 0a30897a10d8467aa294f24954368a84 and project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:17:19.043198 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:17:19.045569 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:17:19.095278 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4e0f41e8-17ac-4986-8625-71b03d8a355d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.570334 Aug 10 11:17:19.096065 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 192/374] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:17:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:17:19.106634 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f3c5a6c7-ce50-4572-98fa-6a5f9aff3e89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:19.107252 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f3c5a6c7-ce50-4572-98fa-6a5f9aff3e89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:19.161402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f3c5a6c7-ce50-4572-98fa-6a5f9aff3e89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:19.168286 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f3c5a6c7-ce50-4572-98fa-6a5f9aff3e89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1241 microversion: 2.1 time: 0.065580 Aug 10 11:17:19.168856 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 183/375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:19 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:17:19.519322 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:19.520049 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:19.526115 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:19.526617 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:19.527231 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:19.527915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:19.528362 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:19.528780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:19.662353 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:19.670873 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d10fbd46-a8f4-436c-abe4-72674cf6c199 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.155827 Aug 10 11:17:19.671384 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 193/376] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:19 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:20.189241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:20.189857 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:20.196418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:20.196907 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:20.197344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:20.198244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:20.198733 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:20.199164 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:20.278529 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:20.287123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02149141-8411-47ca-9f8b-ad6042cd09e8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1301 microversion: 2.1 time: 0.102448 Aug 10 11:17:20.287785 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 184/377] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:20 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:17:20.691735 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:20.692344 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:20.698716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:20.699203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:20.699638 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:20.700328 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:20.700780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:20.701231 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:20.909742 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:20.917718 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2d89ea9f-9bb0-4c59-a4ae-b4c54b4df979 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.229794 Aug 10 11:17:20.918294 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 194/378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:20 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:21.311760 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:21.312619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:21.319653 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:21.320219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:21.320721 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:21.321658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:21.322146 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:21.322590 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:21.548320 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:21.558647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f3f115a7-3eab-4ea1-a18e-89c97781c524 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1367 microversion: 2.1 time: 0.250965 Aug 10 11:17:21.566429 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 185/379] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:21 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:21.851280 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-9a602e09-dd6a-4518-94fc-c5cbd7802f59 req-5ddb55af-d186-4a27-b3ef-72215c3607a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e362be-7551-4ab4-98ec-7920d5ca5d63", "tag": "c5f91161-224c-4d55-8a22-a0437849ae4f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:21.862518 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-9a602e09-dd6a-4518-94fc-c5cbd7802f59 req-5ddb55af-d186-4a27-b3ef-72215c3607a2 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:21.863030 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-9a602e09-dd6a-4518-94fc-c5cbd7802f59 req-5ddb55af-d186-4a27-b3ef-72215c3607a2 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:21.863459 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-9a602e09-dd6a-4518-94fc-c5cbd7802f59 req-5ddb55af-d186-4a27-b3ef-72215c3607a2 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:21.875408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-9a602e09-dd6a-4518-94fc-c5cbd7802f59 req-5ddb55af-d186-4a27-b3ef-72215c3607a2 service nova] Creating event network-changed:c5f91161-224c-4d55-8a22-a0437849ae4f for instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 on hv-cinder-85272 Aug 10 11:17:21.880195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-9a602e09-dd6a-4518-94fc-c5cbd7802f59 req-5ddb55af-d186-4a27-b3ef-72215c3607a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032624 Aug 10 11:17:21.880787 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 195/380] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:21.939542 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:21.940152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:21.945984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:21.946465 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:21.946938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:21.947635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:21.948091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:21.948518 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:22.157895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:22.165952 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dcee33df-1d15-4eeb-877f-be31571e3d7a tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.231012 Aug 10 11:17:22.166513 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 186/381] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:21 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:17:22.581086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:22.581725 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:22.587863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:22.588349 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:22.588784 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:22.589477 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:22.589932 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:22.590356 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:22.720265 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:22.727759 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-844bd96b-4c09-434e-93d2-c93f7af28383 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1367 microversion: 2.1 time: 0.151586 Aug 10 11:17:22.728246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 196/382] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:22 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:23.194884 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:23.195508 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:23.201841 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:23.202318 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:23.202775 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:23.203457 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:23.204393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:23.204810 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:23.328450 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:23.336719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7b170397-db25-409a-ae2e-37b7b83926fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.145734 Aug 10 11:17:23.337273 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 187/383] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:23 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:23.748101 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:23.748711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:23.756474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:23.756956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:23.757388 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:23.758097 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:23.758530 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:23.758989 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:23.884499 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:23.892473 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-85b5f8c1-e9cb-4c23-afc9-17fc8c864201 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1367 microversion: 2.1 time: 0.148227 Aug 10 11:17:23.893052 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 197/384] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:23 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:24.357869 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:24.358476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:24.364915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:24.365396 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:24.365829 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:24.366519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:24.366997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:24.367423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:24.497386 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:24.505895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8644ec71-8538-4054-87af-a14259cebc51 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.151903 Aug 10 11:17:24.506466 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 188/385] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:24 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:24.913722 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:24.914274 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:24.920731 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:24.921215 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:24.921656 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:24.922989 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:24.923450 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:24.923880 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:25.048487 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:25.055816 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cc170776-8851-4cf8-9b75-5c755de80fd4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1367 microversion: 2.1 time: 0.146031 Aug 10 11:17:25.056375 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 198/386] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:24 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:25.527310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:25.527910 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:25.535245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:25.535737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:25.536167 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:25.536872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:25.537334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:25.537753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:25.783504 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:25.791854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-535aafcf-6039-48ae-bfe1-b868d08f8cb2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1724 microversion: 2.1 time: 0.268497 Aug 10 11:17:25.792510 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 189/387] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:25 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:26.076739 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:26.077379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:26.083731 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:26.084216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:26.084650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:26.085348 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:26.085986 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:26.086598 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:26.217311 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:26.224739 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-06fd81e7-3abe-4a21-82f7-687cfed59ed4 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1367 microversion: 2.1 time: 0.152018 Aug 10 11:17:26.225306 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 199/388] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:26 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:26.812789 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:26.813948 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:26.820317 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:26.820799 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:26.821229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:26.821908 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:26.822357 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:26.822806 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:26.953652 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:26.961686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-55d7b91e-e40b-44cd-a856-5e0bc46ea89d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1701 microversion: 2.1 time: 0.152753 Aug 10 11:17:26.962033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 190/389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:26 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:26.981813 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3cdd1aae-c527-4b7a-a5dd-3ef84acf83a6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:26.988213 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3cdd1aae-c527-4b7a-a5dd-3ef84acf83a6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:26.988688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3cdd1aae-c527-4b7a-a5dd-3ef84acf83a6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:26.989117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3cdd1aae-c527-4b7a-a5dd-3ef84acf83a6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:27.050331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3cdd1aae-c527-4b7a-a5dd-3ef84acf83a6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Going to try to start instance {{(pid=117919) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 11:17:27.092887 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3cdd1aae-c527-4b7a-a5dd-3ef84acf83a6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/action" status: 202 len: 0 microversion: 2.1 time: 0.114669 Aug 10 11:17:27.093584 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 200/390] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:17:26 2022] POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:17:27.102379 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:27.103152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:27.110724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:27.111519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:27.111961 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:27.112667 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:27.113122 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:27.113548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:27.131997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:27.245932 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:27.247305 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:27.248070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:27.254684 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:27.255474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:27.256001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:27.256794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:27.257208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-80d8da31-be77-42c3-987e-f889f4b36fa4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1710 microversion: 2.1 time: 0.158794 Aug 10 11:17:27.257457 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:27.258125 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 191/391] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:27 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:17:27.263635 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:27.471096 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:27.474798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:27.479649 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0b50b2f2-e40b-4820-9062-662182aeae51 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1367 microversion: 2.1 time: 0.237973 Aug 10 11:17:27.480228 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 201/392] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:27 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:17:28.279479 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:28.280077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:28.286425 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:28.286960 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:28.287383 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:28.288084 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:28.288530 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:28.288947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:28.424923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:28.434490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3d10d2ae-b01e-45f5-90f7-e75a0e772664 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1710 microversion: 2.1 time: 0.158867 Aug 10 11:17:28.435353 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 192/393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:28 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:28.501249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:28.501841 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:28.508580 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:28.509055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:28.509484 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:28.510162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:28.510642 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:28.511064 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:28.636238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:28.644335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-85ff2035-65ef-4009-9a1b-65227b84f906 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1367 microversion: 2.1 time: 0.148063 Aug 10 11:17:28.644930 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 202/394] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:28 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:29.041935 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-27395472-ade3-4746-999b-12a5367d53cb req-b809b60f-7b3c-4d35-817e-9c06328c9747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e362be-7551-4ab4-98ec-7920d5ca5d63", "name": "network-vif-plugged", "status": "completed", "tag": "c5f91161-224c-4d55-8a22-a0437849ae4f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:29.052677 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-27395472-ade3-4746-999b-12a5367d53cb req-b809b60f-7b3c-4d35-817e-9c06328c9747 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:29.053176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-27395472-ade3-4746-999b-12a5367d53cb req-b809b60f-7b3c-4d35-817e-9c06328c9747 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:29.053607 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-27395472-ade3-4746-999b-12a5367d53cb req-b809b60f-7b3c-4d35-817e-9c06328c9747 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:29.065727 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-27395472-ade3-4746-999b-12a5367d53cb req-b809b60f-7b3c-4d35-817e-9c06328c9747 service nova] Creating event network-vif-plugged:c5f91161-224c-4d55-8a22-a0437849ae4f for instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 on hv-cinder-85272 Aug 10 11:17:29.070916 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-27395472-ade3-4746-999b-12a5367d53cb req-b809b60f-7b3c-4d35-817e-9c06328c9747 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032741 Aug 10 11:17:29.071502 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 193/395] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:29.458946 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:29.459553 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:29.461389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:29.462060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:29.467567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:29.468172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:29.468607 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:29.469860 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:29.470234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:29.470683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:29.593721 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:29.602312 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b487420e-0356-40f0-869c-d3e5f1234139 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1714 microversion: 2.1 time: 0.147489 Aug 10 11:17:29.602905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 203/396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:29 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1714 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:29.662343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:29.666903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:29.667591 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:29.669322 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:29.675247 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:29.675723 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:29.676150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:29.676827 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:29.677273 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:29.677689 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:29.805328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:29.813154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f51fbd2f-5ecd-4c1b-9eb9-e2eef70eb825 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1367 microversion: 2.1 time: 0.151722 Aug 10 11:17:29.813739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 194/397] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:29 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:30.833466 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:30.834073 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:30.836388 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:30.841734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:30.842217 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:30.842677 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:30.843371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:30.843820 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:30.844749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:30.972557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:30.979934 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-94ceafbe-feea-4016-8977-62c5dec04949 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1367 microversion: 2.1 time: 0.150264 Aug 10 11:17:30.980489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 204/398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:30 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:32.001286 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:32.001897 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:32.008194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:32.008674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:32.009105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:32.009790 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:32.010242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:32.010696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:32.136507 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:32.144498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3d10ea4-0831-4468-a669-ab41b8ef9956 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1557 microversion: 2.1 time: 0.147074 Aug 10 11:17:32.145052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 195/399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:17:31 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:32.166026 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-36b9d238-510b-483c-b6a2-042fcc2fcc71 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:32.167275 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-36b9d238-510b-483c-b6a2-042fcc2fcc71 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:32.173766 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36b9d238-510b-483c-b6a2-042fcc2fcc71 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:32.174277 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36b9d238-510b-483c-b6a2-042fcc2fcc71 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:32.174740 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36b9d238-510b-483c-b6a2-042fcc2fcc71 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:32.175430 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36b9d238-510b-483c-b6a2-042fcc2fcc71 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:32.175880 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36b9d238-510b-483c-b6a2-042fcc2fcc71 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:32.176301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36b9d238-510b-483c-b6a2-042fcc2fcc71 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:32.258422 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-36b9d238-510b-483c-b6a2-042fcc2fcc71 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096418 Aug 10 11:17:32.259070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 205/400] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 11:17:32 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:33.167099 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-102dc1db-cbe2-4a9c-bed7-ab8ecab9651c req-fde5bc4c-0aee-4d04-b7b4-03a30c2bbb92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e362be-7551-4ab4-98ec-7920d5ca5d63", "tag": "c5f91161-224c-4d55-8a22-a0437849ae4f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:33.176812 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-102dc1db-cbe2-4a9c-bed7-ab8ecab9651c req-fde5bc4c-0aee-4d04-b7b4-03a30c2bbb92 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:33.177406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-102dc1db-cbe2-4a9c-bed7-ab8ecab9651c req-fde5bc4c-0aee-4d04-b7b4-03a30c2bbb92 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:33.177844 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-102dc1db-cbe2-4a9c-bed7-ab8ecab9651c req-fde5bc4c-0aee-4d04-b7b4-03a30c2bbb92 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:33.190118 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-102dc1db-cbe2-4a9c-bed7-ab8ecab9651c req-fde5bc4c-0aee-4d04-b7b4-03a30c2bbb92 service nova] Creating event network-changed:c5f91161-224c-4d55-8a22-a0437849ae4f for instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 on hv-cinder-85272 Aug 10 11:17:33.195252 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-102dc1db-cbe2-4a9c-bed7-ab8ecab9651c req-fde5bc4c-0aee-4d04-b7b4-03a30c2bbb92 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031864 Aug 10 11:17:33.195912 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 196/401] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:37.689972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6928352c-1789-4cfc-989a-97cce6dc1fe9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:37.690553 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6928352c-1789-4cfc-989a-97cce6dc1fe9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:37.696408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6928352c-1789-4cfc-989a-97cce6dc1fe9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:37.696884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6928352c-1789-4cfc-989a-97cce6dc1fe9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:37.697319 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6928352c-1789-4cfc-989a-97cce6dc1fe9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:37.698008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6928352c-1789-4cfc-989a-97cce6dc1fe9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:37.698460 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6928352c-1789-4cfc-989a-97cce6dc1fe9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:37.698907 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6928352c-1789-4cfc-989a-97cce6dc1fe9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:37.721798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6928352c-1789-4cfc-989a-97cce6dc1fe9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/ips" status: 200 len: 151 microversion: 2.20 time: 0.037122 Aug 10 11:17:37.722345 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 206/402] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 10 11:17:37 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:17:39.588107 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:39.588653 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:39.594927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:39.595434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:39.595874 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:39.596571 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:39.597031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:39.597466 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:39.619552 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lazy-loading 'flavor' on Instance uuid 2ee85970-24fd-4e03-9c90-460c66ab82e9 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:17:39.855091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-af68f25e-b6de-4923-bc54-ea8543212c8c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/action" status: 202 len: 0 microversion: 2.20 time: 0.271624 Aug 10 11:17:39.855682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 197/403] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 10 11:17:39 2022] POST /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:17:39.864455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:39.865131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:39.871783 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:39.872273 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:39.872717 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:39.873572 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:39.874007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:39.874592 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:40.006272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:40.014187 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:40.015733 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:40.017163 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-36e81f96-41dd-4800-b537-22d152b52179 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.157152 Aug 10 11:17:40.017864 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 207/404] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:39 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:41.041041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:41.041739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:41.048003 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:41.048519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:41.048953 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:41.049641 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:41.050096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:41.050518 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:41.181863 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:41.189941 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:41.191458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:41.192602 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e8a19643-c8ad-4f26-abd1-b2c9dbd30adc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.156294 Aug 10 11:17:41.193148 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 198/405] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:41 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:42.215335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:42.215941 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:42.222317 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:42.222828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:42.223261 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:42.223947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:42.224402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:42.224827 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:42.352086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:42.359973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:42.362104 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:42.363287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4306563-b61e-42b3-8419-c6a9464fa7e8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.151827 Aug 10 11:17:42.363875 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 208/406] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:42 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:43.385567 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:43.386208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:43.393255 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:43.393735 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:43.394170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:43.394880 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:43.395335 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:43.395759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:43.526441 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:43.534345 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:43.535879 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:43.537023 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6ff2aa7f-81a1-4212-905c-b4013783f2dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.155388 Aug 10 11:17:43.537581 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 199/407] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:43 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:44.559153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:44.559752 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:44.566333 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:44.566850 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:44.567276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:44.567950 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:44.568394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:44.568808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:44.694503 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:44.702403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:44.703922 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:44.705554 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a6fbe70e-fff9-4a34-bb29-bf6200c78191 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.150287 Aug 10 11:17:44.706097 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 209/408] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:44 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:45.728959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:45.729565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:45.736471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:45.736987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:45.737418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:45.738105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:45.738565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:45.739010 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:45.866676 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:45.874434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:45.875950 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:45.877140 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a332bf4c-f48c-45fc-9bab-fb8e1a619782 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.152185 Aug 10 11:17:45.877690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 200/409] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:45 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:46.899105 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:46.899709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:46.905945 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:46.906419 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:46.906888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:46.907569 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:46.908651 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:46.909072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:47.033486 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:47.041460 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:47.043044 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:47.044196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-21898712-ea26-4e56-b482-fe64089fe99e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.148971 Aug 10 11:17:47.044746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 210/410] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:46 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:48.068095 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:48.068713 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:48.074979 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:48.075462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:48.075894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:48.076582 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:48.077033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:48.077457 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:48.201543 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:48.209991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:48.211557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:48.212706 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-24be6f85-a2f6-4401-abed-8903d227a62d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.149862 Aug 10 11:17:48.213265 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 201/411] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:48 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:49.235077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:49.235686 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:49.242059 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:49.242543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:49.243014 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:49.243704 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:49.244162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:49.244592 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:49.383330 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:49.391119 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:49.393125 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:49.394432 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b448e23e-0466-45d3-a384-29804c4c1bea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.163090 Aug 10 11:17:49.395030 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 211/412] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:49 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:50.417683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:50.418331 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:50.425451 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:50.425927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:50.426354 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:50.427074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:50.427523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:50.427940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:50.553849 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:50.561887 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:50.563416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:50.564575 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fd65e0e0-cf4d-4590-af36-edf32d8f9fbc tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.151241 Aug 10 11:17:50.565131 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 202/413] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:50 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:51.586706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:51.587307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:51.593836 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:51.594306 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:51.594774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:51.596050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:51.596497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:51.596914 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:51.727251 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:51.735010 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:51.736509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:51.737657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c2acaae2-f60c-432c-b7d3-7a6922fdb2cd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.154871 Aug 10 11:17:51.738216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 212/414] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:51 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:52.760618 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:52.761230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:52.768283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:52.768764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:52.769209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:52.769901 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:52.770357 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:52.770814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:52.897241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:52.905162 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:52.906693 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:52.908465 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f5030cae-55cd-4afe-9d87-154c937c0a0a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.151132 Aug 10 11:17:52.909164 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 203/415] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:52 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:53.931101 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:53.931703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:53.938279 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:53.938800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:53.939232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:53.939920 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:53.940371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:53.940795 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:54.068754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:54.076543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:54.078039 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:54.079229 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dfd528db-b026-4d4f-8d19-2dc93149f2a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.152032 Aug 10 11:17:54.080393 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 213/416] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:53 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:55.102517 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:55.103156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:55.109533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:55.110011 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:55.110445 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:55.111651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:55.112104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:55.112524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:55.595095 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:55.603225 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:55.604717 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:55.605848 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eb6e5067-f629-4ebe-941e-d6ea1734265a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.507210 Aug 10 11:17:55.606403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 204/417] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:55 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:56.284477 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f1b0814a-376a-4ffa-b25d-e709f83f538b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf1acf0f-6d61-4d1d-bc46-76a37e21aa00"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:17:56.286913 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f1b0814a-376a-4ffa-b25d-e709f83f538b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:56.292974 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1b0814a-376a-4ffa-b25d-e709f83f538b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:56.293455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1b0814a-376a-4ffa-b25d-e709f83f538b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:56.293891 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1b0814a-376a-4ffa-b25d-e709f83f538b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:56.294615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1b0814a-376a-4ffa-b25d-e709f83f538b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:56.295114 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1b0814a-376a-4ffa-b25d-e709f83f538b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:56.295543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1b0814a-376a-4ffa-b25d-e709f83f538b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:56.629898 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:56.630500 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:56.636902 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:56.637472 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:56.637935 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:56.638627 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:56.639079 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:56.639495 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:56.684757 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f1b0814a-376a-4ffa-b25d-e709f83f538b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508933 Aug 10 11:17:56.685365 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 214/418] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:17:56 2022] POST /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:56.770814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:56.779052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:56.780561 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:56.781701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9d7a23d5-bffa-4c2f-8de9-c78bd02dd819 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.156344 Aug 10 11:17:56.782467 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 205/419] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:56 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:57.805177 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:57.805871 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:57.812192 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:57.812669 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:57.813102 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:57.813788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:57.814760 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:57.815186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:57.943847 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:57.951700 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:57.953219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:57.954354 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e6d9cadf-1ea6-475b-926c-5f546d71216f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1743 microversion: 2.20 time: 0.153904 Aug 10 11:17:57.955612 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 215/420] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:57 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:58.977635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:58.978245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:17:58.984666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:58.985149 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:58.985587 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:58.986280 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:17:58.986774 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:17:58.987204 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:17:58.989819 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:59.114819 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:59.122865 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:59.124405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:17:59.125621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7963a278-18dc-44a6-a762-5ad612b5e793 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1743 microversion: 2.20 time: 0.151897 Aug 10 11:17:59.126181 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 206/421] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:17:58 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:00.148621 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:00.149126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:00.155538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:00.156013 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:00.156467 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:00.157148 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:00.157594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:00.158531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:00.161164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:00.287272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:00.295035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:00.296519 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:00.297657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cef2d444-9696-4859-b839-6f32ea2c589e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1743 microversion: 2.20 time: 0.153059 Aug 10 11:18:00.298218 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 216/422] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:00 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:01.220283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d6286c1d-9a8a-415a-8ff6-ff97f8ed5dd5 req-48074c0e-e126-4b7a-a384-ee4c30d2e564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee85970-24fd-4e03-9c90-460c66ab82e9", "name": "network-vif-plugged", "status": "completed", "tag": "7396eb48-6699-42c7-8c7f-8122d6c9707a"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:01.225351 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=26 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:01.234104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d6286c1d-9a8a-415a-8ff6-ff97f8ed5dd5 req-48074c0e-e126-4b7a-a384-ee4c30d2e564 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:01.234616 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d6286c1d-9a8a-415a-8ff6-ff97f8ed5dd5 req-48074c0e-e126-4b7a-a384-ee4c30d2e564 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:01.235040 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d6286c1d-9a8a-415a-8ff6-ff97f8ed5dd5 req-48074c0e-e126-4b7a-a384-ee4c30d2e564 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:01.246969 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d6286c1d-9a8a-415a-8ff6-ff97f8ed5dd5 req-48074c0e-e126-4b7a-a384-ee4c30d2e564 service nova] Creating event network-vif-plugged:7396eb48-6699-42c7-8c7f-8122d6c9707a for instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 on hv-cinder-85272 Aug 10 11:18:01.252635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d6286c1d-9a8a-415a-8ff6-ff97f8ed5dd5 req-48074c0e-e126-4b7a-a384-ee4c30d2e564 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036085 Aug 10 11:18:01.253430 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 207/423] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:18:01.321313 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:01.321949 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:01.324265 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=26 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:01.329427 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:01.331079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:01.331522 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:01.332220 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:01.332675 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:01.333096 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:01.459689 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:01.467477 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:01.468982 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:01.470128 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6f2e8fac-336b-4695-802d-a0f55f8cf192 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1743 microversion: 2.20 time: 0.152839 Aug 10 11:18:01.471304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 217/424] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:01 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:02.493441 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:02.494133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:02.501093 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:02.502065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:02.502488 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:02.503188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:02.503635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:02.504052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:02.638524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:02.646468 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:02.648002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:02.649135 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-50353bd6-8613-4667-abf6-828a017cf161 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1743 microversion: 2.20 time: 0.159903 Aug 10 11:18:02.649695 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 208/425] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:02 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:03.671988 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:03.672582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:03.679145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:03.679628 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:03.680066 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:03.680760 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:03.681216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:03.681644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:03.809716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:03.818406 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:03.819943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:03.821117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b3d54059-d85f-43ac-b713-94910f0538f5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1743 microversion: 2.20 time: 0.153058 Aug 10 11:18:03.821673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 218/426] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:03 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:04.195657 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:04.198499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:04.205406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:04.205961 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:04.206463 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:04.207215 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:04.207662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:04.208081 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:04.230316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lazy-loading 'flavor' on Instance uuid 6452d7fb-2373-409c-81fe-2c67626068ae {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:18:04.349389 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-561a89d5-3545-407a-87de-3ae450ea3c8d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/action" status: 200 len: 32 microversion: 2.1 time: 0.157448 Aug 10 11:18:04.349897 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 209/427] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:18:04 2022] POST /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:18:04.359519 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:04.360131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:04.367149 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:04.367638 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:04.368069 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:04.368765 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:04.369212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:04.369634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:04.506431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:04.514286 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1fcbcee4-cc17-4c56-b253-eda3cec1deae tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.158736 Aug 10 11:18:04.514873 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 219/428] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:04 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:04.844881 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:04.846069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:04.852411 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:04.852894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:04.853339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:04.854032 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:04.854546 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:04.855000 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:04.982592 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:04.990470 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:04.992010 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:04.993166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e292ee89-e0bc-40e5-a0ce-5eb6d3049da1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.152565 Aug 10 11:18:04.993758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 210/429] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:04 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:05.537754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:05.538368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:05.546785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:05.547277 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:05.547776 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:05.548523 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:05.549475 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:05.550061 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:05.777400 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:05.786933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0d673bb9-b1a3-4880-a67a-6fba92894910 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.255666 Aug 10 11:18:05.788021 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 220/430] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:05 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:06.016343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:06.017373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:06.026242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:06.026765 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:06.027498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:06.028385 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:06.029021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:06.029611 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:06.166292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:06.174476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:06.176000 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:06.177145 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-74540d31-9b08-4f9c-b688-5d136abbd828 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.164934 Aug 10 11:18:06.177706 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 211/431] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:06 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:06.810155 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:06.810805 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:06.817453 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:06.817933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:06.818392 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:06.819103 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:06.819555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:06.819982 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:06.965503 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:06.973560 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-64d9eea6-fdb3-4398-a1ed-4d049c0c78fa tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.167256 Aug 10 11:18:06.974368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 221/432] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:06 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:07.200439 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:07.202126 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:07.209193 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:07.210145 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:07.210607 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:07.211309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:07.211955 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:07.212547 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:07.349764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:07.358233 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:07.359763 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:07.361635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-38fd0274-2836-4b3d-b1d0-5d0b1440044c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.164641 Aug 10 11:18:07.362662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 212/433] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:07 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:07.994476 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:07.995128 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:08.001553 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:08.002034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:08.002514 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:08.003230 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:08.003678 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:08.004100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:08.139099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:08.147306 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-77eaa9c9-1c4f-43cc-af6a-885fde9cd5c2 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.156716 Aug 10 11:18:08.147876 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 222/434] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:07 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:08.385981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:08.387393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:08.396570 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:08.397136 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:08.397622 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:08.398317 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:08.398841 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:08.399222 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:08.540140 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:08.548206 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:08.549770 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:08.550943 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5e0be24d-1cd9-47e9-842f-3eb1f5d0dbf8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.170426 Aug 10 11:18:08.551492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 213/435] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:08 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:09.168879 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:09.169427 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:09.176219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:09.177100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:09.177562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:09.178261 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:09.178746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:09.179171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:09.326258 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:09.335379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-efbd7bfd-319a-4c3d-abe7-a37c49bf98f6 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.171358 Aug 10 11:18:09.348937 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 223/436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:09 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:09.573338 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:09.573946 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:09.581368 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:09.582108 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:09.582736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:09.583682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:09.584368 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:09.585009 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:09.737018 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:09.745329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:09.747190 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:09.748545 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f15e1b90-15a4-4dc6-b7cf-dfc2bb6b002a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.179144 Aug 10 11:18:09.758633 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 214/437] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:09 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:10.356304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:10.357715 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:10.367077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:10.367287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:10.367805 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:10.368426 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:10.368938 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:10.369373 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:10.515842 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:10.524480 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a6b8ca5a-e6e1-482e-82fe-ed212de0ba83 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.172486 Aug 10 11:18:10.525122 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 224/438] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:10 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:10.772151 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:10.772756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:10.781183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:10.781665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:10.782126 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:10.783338 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:10.783799 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:10.784222 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:10.930557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:10.938927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:10.940538 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:10.941684 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6e648877-04a4-44cc-801e-4aef5b116753 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.174239 Aug 10 11:18:10.942239 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 215/439] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:10 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:11.545858 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:11.546477 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:11.554199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:11.555005 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:11.555142 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:11.556006 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:11.557077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:11.557077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:11.701300 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:11.710531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fd040298-7a88-4c7f-85cf-2528198616e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.168904 Aug 10 11:18:11.711436 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 225/440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:11 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:11.964641 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:11.966007 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:11.972515 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:11.973184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:11.973795 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:11.974683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:11.975320 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:11.975864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:12.116286 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:12.125071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:12.126623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:12.127964 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7efdb8db-0070-4a90-812a-f8b1c7a482b3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.167303 Aug 10 11:18:12.128716 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 216/441] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:11 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:12.733373 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:12.734883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:12.741295 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:12.741776 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:12.742208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:12.743050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:12.743505 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:12.743919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:12.901340 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:12.911321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cb504b00-7f72-4458-b0e3-e24ef5ba62c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.182975 Aug 10 11:18:12.912432 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 226/442] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:12 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:13.155179 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:13.156467 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:13.163137 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:13.163848 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:13.164469 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:13.165360 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:13.166240 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:13.166699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:13.315395 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:13.327824 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:13.330060 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:13.331268 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a57a1c46-fb91-4244-9c84-f64f9f8e170e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.181503 Aug 10 11:18:13.331821 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 217/443] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:13 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:18:13.932585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:13.933234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:13.940381 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:13.941143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:13.941762 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:13.942682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:13.943396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:13.944067 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:14.094156 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:14.103063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e1e77fdc-4423-4b4a-89fc-7bf16a272d14 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.174662 Aug 10 11:18:14.104042 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 227/444] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:13 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:14.353979 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:14.354611 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:14.361805 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:14.362537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:14.362988 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:14.365114 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:14.365678 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:14.366143 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:14.533322 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:14.546511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:14.550850 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:14.553374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8e73e094-30b0-42da-a74d-976c9f1f84ec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.203719 Aug 10 11:18:14.554132 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 218/445] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:14 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:15.126376 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:15.127869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:15.136378 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:15.137151 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:15.137834 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:15.138793 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:15.139483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:15.140048 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:15.279561 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:15.289824 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dd2760e0-7fb4-46d8-8a29-5891d34d79c3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.167661 Aug 10 11:18:15.304393 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 228/446] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:15 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:15.578743 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:15.579347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:15.586980 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:15.588315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:15.588813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:15.589718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:15.590235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:15.590842 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:15.737090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:15.745585 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:15.747108 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:15.748257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bcc77827-a927-49f1-a5d5-b257ed02b750 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.173452 Aug 10 11:18:15.749012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 219/447] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:15 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:16.311558 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:16.312376 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:16.319374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:16.319861 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:16.320304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:16.321000 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:16.321456 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:16.321885 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:16.461742 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:16.469646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-17b02c92-afc7-430e-8dcd-d55898a6a98a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.162119 Aug 10 11:18:16.470209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 229/448] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:16 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:16.771483 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:16.772085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:16.778851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:16.779344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:16.779810 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:16.780505 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:16.780963 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:16.781391 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:16.912145 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:16.919955 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:16.921451 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:16.922606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-46ccfe71-8971-4ff2-a829-df3231cd1206 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1738 microversion: 2.20 time: 0.155203 Aug 10 11:18:16.923154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 220/449] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:16 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:17.491105 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:17.491835 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:17.498221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:17.498737 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:17.499176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:17.499870 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:17.500326 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:17.500754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:17.727396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:17.735319 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-964014ae-3aa8-47e9-938a-68afd4874a68 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.248118 Aug 10 11:18:17.735930 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 230/450] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:17 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:17.945228 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:17.946137 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:17.952503 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:17.952987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:17.953425 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:17.954115 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:17.954567 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:17.955497 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:17.970012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:18.294295 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:18.302160 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:18.303733 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:18.304872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-220e9cf9-1a46-4582-907c-60b7c7a9c3ae tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1720 microversion: 2.20 time: 0.363559 Aug 10 11:18:18.305434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 221/451] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:17 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1720 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:18.756938 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:18.757614 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:18.764148 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:18.764781 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:18.765184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:18.765942 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:18.766462 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:18.767008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:18.905188 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:18.913048 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f1148ee0-ef34-409a-89cf-c6c49c133d52 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.160011 Aug 10 11:18:18.913613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 231/452] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:18 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:19.328348 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:19.329082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:19.335947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:19.336421 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:19.336851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:19.337529 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:19.337974 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:19.338389 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:19.465182 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:19.472986 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:19.474526 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:19.475685 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dd1acae9-2370-48eb-8f9e-fa95d7621eaf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1720 microversion: 2.20 time: 0.151218 Aug 10 11:18:19.476236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 222/453] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:19 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:19.933440 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:19.934047 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:19.940671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:19.941159 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:19.941592 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:19.942279 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:19.942769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:19.943190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:20.069479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:20.071709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:20.078533 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-016cf0f5-4d30-4bd1-8028-a73cf02a338c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.149119 Aug 10 11:18:20.079116 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 232/454] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:19 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:20.498934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:20.499536 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:20.506391 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:20.506898 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:20.507323 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:20.508005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:20.508448 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:20.508864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:20.638928 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:20.646795 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:20.648288 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:20.649418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a82b0b3b-5b12-47da-adaf-7b9e6b5368dd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1663 microversion: 2.20 time: 0.154464 Aug 10 11:18:20.649966 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 223/455] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:20 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:20.671821 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-51cd8058-54ca-49a7-a09b-f98348ceb1a3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bb16c6d-1531-462c-9583-01afc043e61d"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:20.674947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-51cd8058-54ca-49a7-a09b-f98348ceb1a3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:20.681234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51cd8058-54ca-49a7-a09b-f98348ceb1a3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:20.681729 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51cd8058-54ca-49a7-a09b-f98348ceb1a3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:20.682162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51cd8058-54ca-49a7-a09b-f98348ceb1a3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:20.682884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51cd8058-54ca-49a7-a09b-f98348ceb1a3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:20.683339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51cd8058-54ca-49a7-a09b-f98348ceb1a3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:20.683762 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51cd8058-54ca-49a7-a09b-f98348ceb1a3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:20.965537 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-51cd8058-54ca-49a7-a09b-f98348ceb1a3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297659 Aug 10 11:18:20.966272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 233/456] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 10 11:18:20 2022] POST /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:18:21.087861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:21.088463 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:21.095106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:21.095917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:21.096358 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:21.097070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:21.097529 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:21.097960 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:21.100900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:21.102026 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:21.108857 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:21.109352 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:21.109791 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:21.110956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:21.111560 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:21.112000 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:21.146783 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117920) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 11:18:21.216057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [b381082a-f26b-410d-bcda-f7887eee3f6b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 11:18:21.251316 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:21.259791 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7c9c8a30-e39e-4a79-8103-1d0f1014fc78 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.163204 Aug 10 11:18:21.260447 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 234/457] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:21 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:21.335458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-1ab38837-2d7a-4152-afb0-6cf03c390325 req-7e433ff1-10df-4f24-afe7-664975b938e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee85970-24fd-4e03-9c90-460c66ab82e9", "name": "network-vif-unplugged", "status": "completed", "tag": "7396eb48-6699-42c7-8c7f-8122d6c9707a"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:21.344818 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1ab38837-2d7a-4152-afb0-6cf03c390325 req-7e433ff1-10df-4f24-afe7-664975b938e9 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:21.345325 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1ab38837-2d7a-4152-afb0-6cf03c390325 req-7e433ff1-10df-4f24-afe7-664975b938e9 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:21.345750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1ab38837-2d7a-4152-afb0-6cf03c390325 req-7e433ff1-10df-4f24-afe7-664975b938e9 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:21.356710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.compute.server_external_events [req-1ab38837-2d7a-4152-afb0-6cf03c390325 req-7e433ff1-10df-4f24-afe7-664975b938e9 service nova] Unable to find a host for instance 2ee85970-24fd-4e03-9c90-460c66ab82e9. Dropping event network-vif-unplugged {{(pid=117919) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 11:18:21.357658 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-1ab38837-2d7a-4152-afb0-6cf03c390325 req-7e433ff1-10df-4f24-afe7-664975b938e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025977 Aug 10 11:18:21.358236 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 235/458] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 11:18:22.223737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [b381082a-f26b-410d-bcda-f7887eee3f6b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49728. Aug 10 11:18:22.226977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a295d967-f208-4a7b-a70a-f9e590954bd4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/action" status: 202 len: 0 microversion: 2.20 time: 1.142965 Aug 10 11:18:22.227592 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 224/459] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 10 11:18:21 2022] POST /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/action => generated 0 bytes in 1144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:18:22.235570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:22.236248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:22.242713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:22.243199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:22.243634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:22.244332 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:22.244784 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:22.245281 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:22.281551 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:22.282267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:22.289780 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:22.290276 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:22.290759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:22.291601 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:22.292062 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:22.292489 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:22.424437 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:22.435427 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:22.437666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:22.440127 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6dbe9fbf-befc-4684-be37-72503f661787 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1749 microversion: 2.20 time: 0.206964 Aug 10 11:18:22.440127 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 236/460] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:22 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1749 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:22.471207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:22.479546 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b9af6ba-8512-4288-8935-d32c74abab5d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.202275 Aug 10 11:18:22.480119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 225/461] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:22 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:23.461212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:23.461814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:23.468123 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:23.468596 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:23.469031 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:23.469710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:23.470155 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:23.471087 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:23.501059 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:23.501693 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:23.508094 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:23.508584 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:23.509023 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:23.509719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:23.510182 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:23.510637 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:23.648327 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:23.657397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:23.659667 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:23.660984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0ccc48e0-6bea-4c81-9c91-2c1c9695c912 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1749 microversion: 2.20 time: 0.203633 Aug 10 11:18:23.661535 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 237/462] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:23 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1749 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:18:23.674543 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:23.682563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-15d18a3e-81fc-4041-b3b4-00f59985fb46 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.185338 Aug 10 11:18:23.683138 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 226/463] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:23 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:18:24.683669 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:24.684204 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:24.690872 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:24.691346 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:24.691770 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:24.692445 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:24.692889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:24.693307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:24.702922 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:24.703525 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:24.710393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:24.711091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:24.711676 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:24.712533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:24.713176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:24.713742 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:24.881390 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:24.889752 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:24.891319 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:24.892478 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d17ed439-94f0-492d-94bf-77dcbff6fe1d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1751 microversion: 2.20 time: 0.212765 Aug 10 11:18:24.893032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 238/464] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:24 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1751 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:18:24.904825 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:24.913281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-58f33aaa-69f0-46ac-9c66-77017aec0484 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1734 microversion: 2.1 time: 0.214139 Aug 10 11:18:24.913843 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 227/465] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:24 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:18:25.916660 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:25.917262 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:25.923629 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:25.924109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:25.924538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:25.925252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:25.925701 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:25.926121 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:25.934716 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:25.935410 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:25.942167 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:25.942681 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:25.943119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:25.943823 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:25.944270 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:25.944697 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:26.195604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:26.203904 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:26.205902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:26.207100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-28bd235f-56ce-46af-9daf-635708bab1e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.294308 Aug 10 11:18:26.207658 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 239/466] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:25 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:26.223195 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:26.231231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0dc5c76d-0138-4eb6-9cf4-df1161b9c44b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1714 microversion: 2.1 time: 0.300278 Aug 10 11:18:26.231790 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 228/467] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:25 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1714 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:18:26.291100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:26.291647 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:26.297539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:26.298023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:26.298461 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:26.299217 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:26.299673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:26.300099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:26.425695 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] HTTP exception thrown: Cannot 'detach_volume' instance 6452d7fb-2373-409c-81fe-2c67626068ae while it is in vm_state rescued Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Request method failure captured: Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments/bf1acf0f-6d61-4d1d-bc46-76a37e21aa00 HTTP/1.1 Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85K2E2Wrim3-FxJMDYkkzQ_TMt5XzYbkWrEXOnPp9f0n4bCiKVg5CauNkfwdqiV0X33kGX_Mxw_UEozhsObEyrl7sEgn5MXwNG1VgK0TxGl-tvYd7MgLVE2Sx7DPXAFidcuR5kUzdLm67tAihNIGsOEgKSQHtJi9BHRYLOrW4INPUEk Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:18:26.427334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 5d1368fb915444b599b3fcf3f5586789 Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:18:26.428808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Cannot 'detach_volume' instance 6452d7fb-2373-409c-81fe-2c67626068ae while it is in vm_state rescued Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'server_id': '6452d7fb-2373-409c-81fe-2c67626068ae', 'id': 'bf1acf0f-6d61-4d1d-bc46-76a37e21aa00'} Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6452d7fb-2373-409c-81fe-2c67626068ae in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:18:26.429490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6452d7fb-2373-409c-81fe-2c67626068ae while it is in vm_state rescued Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6452d7fb-2373-409c-81fe-2c67626068ae while it is in vm_state rescued Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:18:26.430774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Returning 409 to user: Cannot 'detach_volume' instance 6452d7fb-2373-409c-81fe-2c67626068ae while it is in vm_state rescued {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:18:26.431758 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b29ccc19-507a-411d-94fa-dde225f9eda3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments/bf1acf0f-6d61-4d1d-bc46-76a37e21aa00" status: 409 len: 152 microversion: 2.1 time: 0.141605 Aug 10 11:18:26.431758 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 240/468] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:18:26 2022] DELETE /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments/bf1acf0f-6d61-4d1d-bc46-76a37e21aa00 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 11:18:26.437930 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b93f3abc-46a1-4e6c-bfe9-b830e24bf43c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:26.438772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b93f3abc-46a1-4e6c-bfe9-b830e24bf43c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:26.444867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93f3abc-46a1-4e6c-bfe9-b830e24bf43c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:26.445533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93f3abc-46a1-4e6c-bfe9-b830e24bf43c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:26.445968 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93f3abc-46a1-4e6c-bfe9-b830e24bf43c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:26.446689 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93f3abc-46a1-4e6c-bfe9-b830e24bf43c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:26.447242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93f3abc-46a1-4e6c-bfe9-b830e24bf43c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:26.447671 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93f3abc-46a1-4e6c-bfe9-b830e24bf43c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:26.517932 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b93f3abc-46a1-4e6c-bfe9-b830e24bf43c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "POST /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/action" status: 202 len: 0 microversion: 2.1 time: 0.083856 Aug 10 11:18:26.518561 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 229/469] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:18:26 2022] POST /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:18:26.527049 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:26.527905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:26.537534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:26.538167 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:26.538621 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:26.539527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:26.540131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:26.540773 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:26.682001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:26.690392 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6581d746-a644-4f9c-96cf-21f64c42e7e0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.167383 Aug 10 11:18:26.691058 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 241/470] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:26 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:27.231583 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:27.232285 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:27.238872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:27.239412 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:27.239852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:27.240545 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:27.241003 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:27.241428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:27.380486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:27.393627 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:27.396307 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:27.397988 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8374b96-c5c5-4bb9-8f17-5580d5515cdb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.171036 Aug 10 11:18:27.413686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 230/471] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:27 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:18:27.711396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:27.712081 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:27.718474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:27.718975 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:27.719403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:27.720078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:27.721186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:27.721616 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:27.853895 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:27.862125 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2508a5f4-b55e-4482-b8ed-9359985d7033 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.154621 Aug 10 11:18:27.866609 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 242/472] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:27 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:28.424752 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:28.425354 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:28.432010 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:28.432497 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:28.432928 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:28.433616 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:28.434066 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:28.434490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:28.593371 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:28.602005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:28.603545 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:28.604730 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-999f4e0a-f114-4fd8-8ab8-f43f3747d71b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.183893 Aug 10 11:18:28.605293 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 231/473] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:28 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:28.883800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:28.884431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:28.890758 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:28.891237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:28.891663 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:28.892418 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:28.892866 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:28.893286 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:29.027201 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:29.035209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c69c9952-a605-4ef5-af79-118c8e962694 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.155411 Aug 10 11:18:29.035771 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 243/474] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:28 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:29.627960 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:29.628852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:29.635762 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:29.636379 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:29.637057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:29.637844 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:29.639038 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:29.655364 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:29.801836 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:29.810151 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:29.811720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:29.813191 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8616af79-b4e8-4166-be04-edf0908912bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.189779 Aug 10 11:18:29.813756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 232/475] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:29 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:30.055943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:30.056567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:30.063613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:30.064622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:30.065061 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:30.065763 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:30.066217 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:30.066665 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:30.229371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:30.238881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1487774f-07b0-41db-97ad-04b134d6d3bb tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.185812 Aug 10 11:18:30.239788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 244/476] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:30 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:30.836539 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:30.837104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:30.843437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:30.843916 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:30.844346 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:30.845026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:30.845987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:30.846403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:30.975432 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:30.983918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:30.985434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:30.987309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5f084624-6d11-466d-9a56-950bd2944875 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.154727 Aug 10 11:18:30.988632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 233/477] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:30 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:31.260133 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:31.260770 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:31.267336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:31.267823 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:31.268259 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:31.268954 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:31.269406 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:31.269827 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:31.407111 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:31.416633 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bc30c009-769c-470f-b382-e133677848b8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.160272 Aug 10 11:18:31.417224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 245/478] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:31 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:32.010165 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:32.011021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:32.012853 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:32.019891 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:32.020440 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:32.020874 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:32.021575 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:32.022166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:32.022617 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:32.157318 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:32.165595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:32.167153 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:32.168313 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8086d7c0-fcdc-442b-af90-145e70a9f3b9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.162206 Aug 10 11:18:32.168877 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 234/479] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:32 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:32.437803 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:32.438372 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:32.440662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=58 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:32.446458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:32.446974 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:32.447413 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:32.448114 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:32.448569 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:32.448998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:32.601355 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:32.609312 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-07f2e7c9-4112-40ca-b5fd-e27d59aace54 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.175695 Aug 10 11:18:32.609877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 246/480] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:32 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:33.192048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:33.192656 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:33.199103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:33.199591 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:33.200024 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:33.200734 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:33.201174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:33.201597 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:33.342761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:33.351223 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:33.352747 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:33.354185 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ba21085c-3e9a-4254-a813-09d9618f2a37 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.166090 Aug 10 11:18:33.354775 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 235/481] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:33 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:33.631320 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:33.631930 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:33.638272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:33.638801 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:33.639237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:33.639920 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:33.640370 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:33.640789 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:33.655176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:33.784842 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:33.796164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-34e65a60-2c9f-4965-93f4-0cf8e268e171 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.169201 Aug 10 11:18:33.796746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 247/482] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:33 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:34.379376 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:34.379977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:34.386381 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:34.386922 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:34.387359 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:34.388059 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:34.388510 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:34.388934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:34.392806 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:34.525984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:34.534816 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:34.536349 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:34.537498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-76237eb5-6bf4-4cd4-ae0c-e81788b8de96 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.162771 Aug 10 11:18:34.538048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 236/483] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:34 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:34.819174 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:34.819836 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:34.826379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:34.826894 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:34.827331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:34.828024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:34.828493 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:34.828905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:34.965969 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:34.974056 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c0a69932-668d-4459-bb69-c5bbc1c28cc9 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.158746 Aug 10 11:18:34.987708 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 248/484] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:34 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:35.560271 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:35.560892 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:35.567523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:35.568006 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:35.568446 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:35.569241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:35.569725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:35.570153 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:35.707135 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:35.719895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:35.721531 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:35.722728 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1781229b-b2d8-40d5-8569-00a41b52ca97 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.166385 Aug 10 11:18:35.723287 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 237/485] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:35 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:35.995219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:35.995837 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:36.002611 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:36.003097 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:36.003591 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:36.004268 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:36.004791 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:36.005216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:36.141833 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:36.150464 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1403ad25-a05b-4df7-a440-9295fa40c662 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.159106 Aug 10 11:18:36.151109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 249/486] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:35 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:36.747060 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:36.747820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:36.755247 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:36.755751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:36.756168 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:36.756876 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:36.757332 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:36.757755 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:36.896231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:36.904660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:36.906172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:36.907455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fbc91ca2-884d-43c5-9617-a975cdea944a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.164291 Aug 10 11:18:36.908566 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 238/487] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:36 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:37.171509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:37.172213 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:37.178804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:37.179572 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:37.180216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:37.180912 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:37.181361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:37.181782 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:37.314775 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:37.322628 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c132bd71-faa6-40e5-b095-159e9e928a29 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.154953 Aug 10 11:18:37.323202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 250/488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:37 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:37.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:37.931215 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:37.938176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:37.938687 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:37.939167 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:37.940379 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:37.940833 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:37.941257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:38.073054 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:38.081938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:38.083472 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:38.084623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e9c5906f-ef1b-4ea4-93bf-5425f135d9e0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.157914 Aug 10 11:18:38.085183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 239/489] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:37 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:38.343655 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:38.344260 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:38.350677 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:38.351164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:38.351601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:38.352290 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:38.352744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:38.353171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:38.486922 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:38.494874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-10b73a5a-3902-4ee5-8e97-dc7c6ef62d39 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.155027 Aug 10 11:18:38.495441 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 251/490] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:38 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:39.025995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:18:39.026170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Wed Aug 10 11:18:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:18:39.107650 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:39.108255 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:39.114772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:39.115283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:39.115714 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:39.116401 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:39.116904 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:39.117281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:39.242192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:39.250684 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:39.252747 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:39.253887 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a65956e3-c34d-49ea-8376-7a94b003bd1e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.150122 Aug 10 11:18:39.254443 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 240/491] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:39 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:39.516511 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:39.517122 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:39.524085 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:39.524563 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:39.524998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:39.525684 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:39.526138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:39.526566 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:39.653436 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:39.661942 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cab352b0-6071-4b9c-89e6-0adaa4ad7dc7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.149288 Aug 10 11:18:39.662502 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 252/492] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:39 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:40.277236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:40.277839 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:40.284511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:40.284987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:40.285414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:40.286097 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:40.286565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:40.287006 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:40.414642 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:40.422928 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:40.424909 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:40.426050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1ae1e40-26c8-4d05-836a-421157f954bf tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.152752 Aug 10 11:18:40.426635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 241/493] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:40 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:40.682607 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:40.683220 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:40.689805 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:40.690286 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:40.690754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:40.691440 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:40.691892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:40.692312 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:40.819627 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:40.827418 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2a462725-7b3a-4ff2-b7d2-28399f11fc37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.148618 Aug 10 11:18:40.827977 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 253/494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:40 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:41.449193 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:41.449801 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:41.456903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:41.457420 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:41.457855 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:41.458552 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:41.459029 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:41.459454 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:41.587807 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:41.596322 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:41.597812 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:41.599001 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a16157c-ac6b-41f5-bd9d-e4e205305d20 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.153735 Aug 10 11:18:41.599528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 242/495] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:41 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:41.848798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:41.849333 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:41.855786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:41.856265 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:41.856704 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:41.857395 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:41.857850 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:41.858274 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:41.983371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:41.991214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2501503b-e4ef-4e0c-a018-50a68f5b9d2d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.146984 Aug 10 11:18:41.991778 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 254/496] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:41 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:42.621420 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:42.622026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:42.628528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:42.629013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:42.629447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:42.630137 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:42.630611 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:42.631037 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:42.763583 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:42.772635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:42.774154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:42.775343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-805b94c5-f15f-4873-aa6f-f3fb3acc5579 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.157812 Aug 10 11:18:42.775899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 243/497] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:42 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:43.012434 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:43.012977 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:43.019405 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:43.019889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:43.020324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:43.021012 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:43.021467 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:43.021893 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:43.146479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:43.154307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bc5ce7ef-ad60-4680-87c4-15f8bc230085 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.145747 Aug 10 11:18:43.154905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 255/498] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:43 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:43.798122 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:43.799362 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:43.805769 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:43.806251 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:43.806713 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:43.807412 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:43.807866 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:43.808288 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:43.941197 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:43.949476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:43.951035 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:43.952179 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffaf76a2-cae5-41d3-b395-c1305c498159 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.157950 Aug 10 11:18:43.952728 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 244/499] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:43 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:44.176854 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:44.177372 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:44.183660 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:44.184132 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:44.184562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:44.185239 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:44.185685 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:44.186106 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:44.311943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:44.319995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9d09913d-a798-4c94-b226-786e1bb9e168 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.147840 Aug 10 11:18:44.320555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 256/500] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:44 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:44.974766 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:44.975373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:44.981677 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:44.982165 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:44.982621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:44.983315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:44.983769 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:44.984192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:45.109608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:45.123240 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:45.124704 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:45.125864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-52df59e3-32f6-47fe-81e4-a939d860948f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.155011 Aug 10 11:18:45.126430 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 245/501] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:44 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:45.340736 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:45.341339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:45.347946 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:45.348425 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:45.348857 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:45.349537 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:45.349986 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:45.350403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:45.488771 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:45.497073 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-84e917af-3c2d-491b-beaf-affdb8c24e50 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1722 microversion: 2.1 time: 0.160184 Aug 10 11:18:45.497634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 257/502] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:45 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:46.149365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:46.149905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:46.156268 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:46.156753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:46.157186 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:46.157899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:46.158947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:46.159371 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:46.285041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:46.294833 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:46.296390 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:46.297539 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c9eb3398-9ab6-490d-8dcf-dcccbc5293ea tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.152152 Aug 10 11:18:46.298103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 246/503] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:46 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:46.519124 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:46.519727 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:46.526061 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:46.526531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:46.527016 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:46.527692 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:46.528141 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:46.528555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:46.663539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:46.671540 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-60489742-6d75-4b43-8f52-84e3767c59f3 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1728 microversion: 2.1 time: 0.156905 Aug 10 11:18:46.672095 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 258/504] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:46 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:46.692459 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0f11e66d-69d7-4a80-8dd0-f44e35b15b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:46.692945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0f11e66d-69d7-4a80-8dd0-f44e35b15b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:46.698840 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f11e66d-69d7-4a80-8dd0-f44e35b15b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:46.699316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f11e66d-69d7-4a80-8dd0-f44e35b15b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:46.699745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f11e66d-69d7-4a80-8dd0-f44e35b15b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:46.700429 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f11e66d-69d7-4a80-8dd0-f44e35b15b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:46.700876 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f11e66d-69d7-4a80-8dd0-f44e35b15b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:46.701293 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f11e66d-69d7-4a80-8dd0-f44e35b15b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:46.776787 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0f11e66d-69d7-4a80-8dd0-f44e35b15b3b tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088875 Aug 10 11:18:46.777406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 247/505] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 11:18:46 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:18:47.281367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:47.281801 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:47.287743 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:47.288223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:47.288654 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:47.289336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:47.289785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:47.290203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:47.321511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:47.321880 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:47.327700 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:47.328367 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:47.328804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:47.329631 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:47.330176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:47.330619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:47.374130 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lazy-loading 'services' on Instance uuid b5d74ab5-9978-4af6-9fff-34b86d739057 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:18:47.490750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b366b452-5efc-43d0-af3a-5aa91aeee3ec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/os-volume_attachments/475eb65c-42ba-419b-aa2b-683bd3aeffe5" status: 202 len: 0 microversion: 2.1 time: 0.314216 Aug 10 11:18:47.491496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 259/506] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:18:47 2022] DELETE /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/os-volume_attachments/475eb65c-42ba-419b-aa2b-683bd3aeffe5 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:18:47.773691 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:47.782269 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:47.783887 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:47.785036 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-275484cb-6347-4949-9d69-a5f6dc81b6b8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.468637 Aug 10 11:18:47.785593 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 248/507] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:47 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:48.004957 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-0500ae6d-2a84-41a2-84db-5698d226bd0c req-97351fac-6da1-4434-a8c1-b5565ccbf45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6452d7fb-2373-409c-81fe-2c67626068ae", "tag": "915bfc88-7f55-43d7-b302-6e13fb3394a5"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:48.014397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-0500ae6d-2a84-41a2-84db-5698d226bd0c req-97351fac-6da1-4434-a8c1-b5565ccbf45f service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:48.014907 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-0500ae6d-2a84-41a2-84db-5698d226bd0c req-97351fac-6da1-4434-a8c1-b5565ccbf45f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:48.015336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-0500ae6d-2a84-41a2-84db-5698d226bd0c req-97351fac-6da1-4434-a8c1-b5565ccbf45f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:48.025984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-0500ae6d-2a84-41a2-84db-5698d226bd0c req-97351fac-6da1-4434-a8c1-b5565ccbf45f service nova] Creating event network-changed:915bfc88-7f55-43d7-b302-6e13fb3394a5 for instance 6452d7fb-2373-409c-81fe-2c67626068ae on hv-cinder-85272 Aug 10 11:18:48.030703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-0500ae6d-2a84-41a2-84db-5698d226bd0c req-97351fac-6da1-4434-a8c1-b5565ccbf45f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083247 Aug 10 11:18:48.031285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 260/508] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:18:48.808255 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:48.808900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:48.815688 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:48.816175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:48.816613 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:48.817301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:48.817758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:48.818187 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:48.943192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:48.951520 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:48.953032 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:48.954185 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7d4b584d-bc36-4e96-9af3-91831a815559 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.149842 Aug 10 11:18:48.954810 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 249/509] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:48 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:49.978950 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:49.979643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:49.985717 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:49.986462 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:49.986919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:49.987668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:49.988059 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:49.988499 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:50.058416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-598b4505-aaf0-48fd-8062-e4a638e729ee req-0f6ed678-1829-49c1-b563-4a711c4cce9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6452d7fb-2373-409c-81fe-2c67626068ae", "tag": "915bfc88-7f55-43d7-b302-6e13fb3394a5"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:50.068803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-598b4505-aaf0-48fd-8062-e4a638e729ee req-0f6ed678-1829-49c1-b563-4a711c4cce9b service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:50.069460 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-598b4505-aaf0-48fd-8062-e4a638e729ee req-0f6ed678-1829-49c1-b563-4a711c4cce9b service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:50.069964 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-598b4505-aaf0-48fd-8062-e4a638e729ee req-0f6ed678-1829-49c1-b563-4a711c4cce9b service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:50.082887 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-598b4505-aaf0-48fd-8062-e4a638e729ee req-0f6ed678-1829-49c1-b563-4a711c4cce9b service nova] Creating event network-changed:915bfc88-7f55-43d7-b302-6e13fb3394a5 for instance 6452d7fb-2373-409c-81fe-2c67626068ae on hv-cinder-85272 Aug 10 11:18:50.088164 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-598b4505-aaf0-48fd-8062-e4a638e729ee req-0f6ed678-1829-49c1-b563-4a711c4cce9b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033457 Aug 10 11:18:50.089474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 250/510] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:18:50.132617 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:50.140768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:50.142275 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:50.143509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3e25af4b-581c-47d4-b95b-fb0f9b2ec262 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.169518 Aug 10 11:18:50.144070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 261/511] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:49 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:50.733133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be2e3818-1488-4b7c-8cde-9189c607b320 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:50.740670 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be2e3818-1488-4b7c-8cde-9189c607b320 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:50.741176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be2e3818-1488-4b7c-8cde-9189c607b320 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:50.741620 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be2e3818-1488-4b7c-8cde-9189c607b320 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:50.765504 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be2e3818-1488-4b7c-8cde-9189c607b320 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Going to try to stop instance {{(pid=117920) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 11:18:50.810331 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be2e3818-1488-4b7c-8cde-9189c607b320 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/action" status: 202 len: 0 microversion: 2.1 time: 0.081425 Aug 10 11:18:50.811537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 251/512] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:18:50 2022] POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:18:50.821162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:50.822055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:50.828711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:50.829314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:50.829985 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:50.831013 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:50.831538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:50.832086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:50.971863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:50.979655 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1e01169f-e290-479b-b4e9-df6498bdb74b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.162930 Aug 10 11:18:50.980235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 262/513] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:50 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:51.165785 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:51.166471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:51.173034 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:51.173515 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:51.174701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:51.175576 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:51.176274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:51.176965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:51.313822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:51.316209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:51.324358 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:51.326017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:51.327537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6dd10150-da30-4933-a254-b72da519ef93 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.166041 Aug 10 11:18:51.328101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 252/514] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:51 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:52.001210 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:52.002348 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:52.008724 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:52.009209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:52.009644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:52.010329 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:52.010824 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:52.011249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:52.146039 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:52.153552 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6b17a4be-3b6e-4005-bb97-51a8d37dbef1 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.156162 Aug 10 11:18:52.154195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 263/515] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:51 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:52.349462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:52.350130 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:52.357617 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:52.358105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:52.358542 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:52.359343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:52.359803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:52.360231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:52.487031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:52.495438 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:52.496957 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:52.498115 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe13aa01-b061-48cd-a9bb-34bdb0a118c3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.152861 Aug 10 11:18:52.498752 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 253/516] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:52 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:53.174857 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:53.175391 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:53.181747 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:53.182237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:53.182705 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:53.183397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:53.183855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:53.184283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:53.188555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:53.315056 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:53.322474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c78f351e-4ebd-4202-80b7-e10238ce6f5b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.152065 Aug 10 11:18:53.323083 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 264/517] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:53 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:53.521301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:53.521943 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:53.528654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:53.529217 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:53.529648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:53.530360 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:53.530824 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:53.531250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:53.596351 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-8c87eaf3-04bc-494a-b41b-5c3383e6e3f9 req-7e2b5ac3-91fb-4beb-990e-a36f7035ed86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee85970-24fd-4e03-9c90-460c66ab82e9", "name": "network-vif-plugged", "status": "completed", "tag": "7396eb48-6699-42c7-8c7f-8122d6c9707a"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:18:53.605944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8c87eaf3-04bc-494a-b41b-5c3383e6e3f9 req-7e2b5ac3-91fb-4beb-990e-a36f7035ed86 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:53.607131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8c87eaf3-04bc-494a-b41b-5c3383e6e3f9 req-7e2b5ac3-91fb-4beb-990e-a36f7035ed86 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:53.607131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8c87eaf3-04bc-494a-b41b-5c3383e6e3f9 req-7e2b5ac3-91fb-4beb-990e-a36f7035ed86 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:53.618805 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-8c87eaf3-04bc-494a-b41b-5c3383e6e3f9 req-7e2b5ac3-91fb-4beb-990e-a36f7035ed86 service nova] Creating event network-vif-plugged:7396eb48-6699-42c7-8c7f-8122d6c9707a for instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 on hv-cinder-85272 Aug 10 11:18:53.624803 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-8c87eaf3-04bc-494a-b41b-5c3383e6e3f9 req-7e2b5ac3-91fb-4beb-990e-a36f7035ed86 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093947 Aug 10 11:18:53.625394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 265/518] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:18:53.673698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:53.682311 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:53.683799 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:53.684985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ae850b34-6548-4143-a852-b20f6038c888 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.167611 Aug 10 11:18:53.685543 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 254/519] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:53 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:54.344088 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:54.344790 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:54.350835 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:54.351323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:54.351785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:54.352482 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:54.352933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:54.353363 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:54.478524 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:54.486555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9f5d7083-b25e-45ec-abda-85b4431370f5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.146743 Aug 10 11:18:54.487153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 266/520] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:54 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:54.707586 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:54.708194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:54.714518 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:54.715032 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:54.715464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:54.716149 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:54.716604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:54.717025 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:54.845858 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:54.854295 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:54.855852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:54.856999 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5415db0d-7bad-4bb0-b679-9c6e0ac61ba5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.153308 Aug 10 11:18:54.857544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 255/521] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:54 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:55.507889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:55.508495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:55.515000 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:55.515473 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:55.515905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:55.516584 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:55.517031 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:55.518088 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:55.643150 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:55.650483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-00fea7c7-0808-4069-b5fd-28db0480e92c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.146384 Aug 10 11:18:55.651079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 267/522] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:55 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:55.880920 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:55.881553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:55.888037 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:55.888519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:55.888958 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:55.889645 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:55.890131 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:55.890552 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:56.019570 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:56.028012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:56.029528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:56.030722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-940a7c7a-764d-4612-8246-79b2cf1c000c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1807 microversion: 2.20 time: 0.153809 Aug 10 11:18:56.031375 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 256/523] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:55 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:18:56.670667 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:56.671303 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:56.678232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:56.678742 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:56.679173 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:56.679854 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:56.680298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:56.680716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:56.809080 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:56.817703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-155d72b4-7414-46e2-88c5-a59df2c1ceeb tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.150817 Aug 10 11:18:56.818509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 268/524] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:56 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:57.053285 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:57.053817 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:57.060242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:57.060725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:57.061161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:57.061846 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:57.062299 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:57.062763 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:57.187655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:57.196620 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:57.198104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:57.199266 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9b722a33-264b-4e0f-93c0-bf0177be1005 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1794 microversion: 2.20 time: 0.149941 Aug 10 11:18:57.199814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 257/525] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:18:57 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1794 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:18:57.838288 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:57.838919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:57.845455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:57.845933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:57.846363 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:57.847107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:57.847553 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:57.847976 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:57.986283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:57.993749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ec5ffbe3-533b-4d68-8966-e7b4cf23d96b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.159320 Aug 10 11:18:57.994318 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 269/526] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:57 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:18:59.015886 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:18:59.016495 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:18:59.022946 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:59.023423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:59.023856 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:59.024533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:18:59.024984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:18:59.025406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:18:59.152263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:18:59.159756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c8f0a066-f0fb-460a-be6b-f42bef9b0fcc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.147743 Aug 10 11:18:59.160311 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 258/527] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:18:59 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:00.183030 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:00.183544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:00.190689 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:00.191168 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:00.191595 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:00.192281 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:00.192730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:00.193149 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:00.326176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:00.333683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6f81a049-fb2c-4359-bde6-ab2c9d466e37 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.154537 Aug 10 11:19:00.334250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 270/528] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:00 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:01.355372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:01.355967 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:01.362616 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:01.363105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:01.363540 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:01.364225 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:01.364678 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:01.365107 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:01.489188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:01.496563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6561a7e4-5719-4dd5-9781-0c9191e36002 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.144998 Aug 10 11:19:01.497119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 259/529] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:01 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:02.518730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:02.519274 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:02.521693 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=50 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:02.526814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:02.527290 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:02.527719 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:02.528399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:02.528843 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:02.529261 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:02.663333 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:02.671478 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1a6141f1-061a-428c-9499-5d19ca1281ba tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.157284 Aug 10 11:19:02.672043 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 271/530] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:02 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:02.803589 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6bdaf70e-90c4-4fd3-96ff-d814b481bb95 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:02.804106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6bdaf70e-90c4-4fd3-96ff-d814b481bb95 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:02.805990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=52 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:02.811493 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdaf70e-90c4-4fd3-96ff-d814b481bb95 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:02.811979 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdaf70e-90c4-4fd3-96ff-d814b481bb95 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:02.812422 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdaf70e-90c4-4fd3-96ff-d814b481bb95 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:02.813117 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdaf70e-90c4-4fd3-96ff-d814b481bb95 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:02.813827 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdaf70e-90c4-4fd3-96ff-d814b481bb95 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:02.814291 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdaf70e-90c4-4fd3-96ff-d814b481bb95 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:02.837490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6bdaf70e-90c4-4fd3-96ff-d814b481bb95 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63/ips" status: 200 len: 150 microversion: 2.1 time: 0.096806 Aug 10 11:19:02.838064 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 260/531] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:19:02 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63/ips => generated 150 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:19:02.849769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:02.852168 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:02.858077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:02.858560 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:02.859040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:02.859725 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:02.860170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:02.860587 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:02.938137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Invalid volume: volume d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2 is already attached to instances: 416de879-4113-49f9-b2a9-04398bd17e4a Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63/os-volume_attachments HTTP/1.1 Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 74 Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:19:02.940713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {"volumeAttachment": {"volumeId": "d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2"}} Aug 10 11:19:02.942298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Invalid volume: volume d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2 is already attached to instances: 416de879-4113-49f9-b2a9-04398bd17e4a Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'server_id': '43e362be-7551-4ab4-98ec-7920d5ca5d63', 'body': {'volumeAttachment': {'volumeId': 'd1a2cb4f-ab36-41e9-9e70-a812f4ed61b2'}}} Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2 is already attached to instances: 416de879-4113-49f9-b2a9-04398bd17e4a Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:02.943284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2 is already attached to instances: 416de879-4113-49f9-b2a9-04398bd17e4a Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:02.944710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:19:02.946180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:19:02.946180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:19:02.946180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:19:02.946180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2 is already attached to instances: 416de879-4113-49f9-b2a9-04398bd17e4a Aug 10 11:19:02.946180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:02.946180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 400 to user: Invalid volume: volume d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2 is already attached to instances: 416de879-4113-49f9-b2a9-04398bd17e4a {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:19:02.946180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7806bb68-2079-4112-b69a-29c89b79587d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096654 Aug 10 11:19:02.946180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 272/532] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:19:02 2022] POST /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 11:19:02.951205 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:02.951710 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:02.958976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:02.959471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:02.959913 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:02.960619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:02.961078 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:02.961543 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:02.988092 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:19:03.071548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f2477aad-1afc-4618-ab65-32d07684ad32 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 204 len: 0 microversion: 2.1 time: 0.123849 Aug 10 11:19:03.072263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 261/533] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:19:02 2022] DELETE /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:19:03.080738 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:03.081464 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:03.089493 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:03.090126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:03.090708 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:03.091427 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:03.091862 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:03.092280 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:03.229540 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:03.237746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4a305279-e125-4754-9859-3f7c59c6fdeb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1682 microversion: 2.1 time: 0.161076 Aug 10 11:19:03.238304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 273/534] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:03 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:03.694709 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:03.695405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:03.701310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:03.701788 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:03.702221 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:03.702931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:03.703380 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:03.703797 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:03.830867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:03.838167 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-659d031b-bcfb-4bf7-9cb0-e18958c43b01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.147881 Aug 10 11:19:03.838748 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 262/535] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:03 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:04.259744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:04.260352 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:04.266798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:04.267265 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:04.268202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:04.268884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:04.269336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:04.269761 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:04.399468 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:04.406881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3eedebad-bc7b-469c-8b24-764bbd20c185 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1682 microversion: 2.1 time: 0.150964 Aug 10 11:19:04.407447 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 274/536] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:04 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:04.859257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:04.859798 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:04.867580 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:04.867708 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:04.868059 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:04.868757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:04.869218 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:04.869647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:04.997498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:05.004934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-07edf75c-0218-4dc0-8163-025795f13b76 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.149576 Aug 10 11:19:05.005500 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 263/537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:04 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:05.428472 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:05.429112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:05.435429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:05.435910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:05.436343 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:05.437033 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:05.437485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:05.437915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:05.574114 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:05.581799 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4c7a1736-925d-4f5a-b133-28af83a7ba7e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1682 microversion: 2.1 time: 0.157178 Aug 10 11:19:05.582374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 275/538] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:05 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:06.029023 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b325cc5e-c259-40fc-a9da-fc6025c6c11b req-6c7934f2-3238-469a-80a2-071e86086f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e362be-7551-4ab4-98ec-7920d5ca5d63", "name": "network-vif-deleted", "tag": "c5f91161-224c-4d55-8a22-a0437849ae4f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:06.029924 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:06.030548 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:06.042959 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:06.045429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:06.045881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:06.046624 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:06.047084 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:06.050870 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:06.052176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b325cc5e-c259-40fc-a9da-fc6025c6c11b req-6c7934f2-3238-469a-80a2-071e86086f5a service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:06.054208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b325cc5e-c259-40fc-a9da-fc6025c6c11b req-6c7934f2-3238-469a-80a2-071e86086f5a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:06.056992 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b325cc5e-c259-40fc-a9da-fc6025c6c11b req-6c7934f2-3238-469a-80a2-071e86086f5a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:06.072143 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b325cc5e-c259-40fc-a9da-fc6025c6c11b req-6c7934f2-3238-469a-80a2-071e86086f5a service nova] Creating event network-vif-deleted:c5f91161-224c-4d55-8a22-a0437849ae4f for instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 on hv-cinder-85272 Aug 10 11:19:06.077102 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b325cc5e-c259-40fc-a9da-fc6025c6c11b req-6c7934f2-3238-469a-80a2-071e86086f5a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125114 Aug 10 11:19:06.077954 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 264/539] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:19:06.198743 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:06.207631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7bb8a5c3-fd9c-4afb-98b8-4e5b4d95dde5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1678 microversion: 2.1 time: 0.185816 Aug 10 11:19:06.208205 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 276/540] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:06 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:06.604277 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:06.608528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:06.621759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:06.622262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:06.627901 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:06.628721 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:06.629214 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:06.629672 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:06.668232 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:06.668726 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:06.669985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:06.670717 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lazy-loading 'fault' on Instance uuid 43e362be-7551-4ab4-98ec-7920d5ca5d63 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:19:06.721875 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:06.732894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8024ff30-8673-43fd-bce8-9d194527062d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 200 len: 1331 microversion: 2.1 time: 0.131106 Aug 10 11:19:06.733713 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 265/541] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:06 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 1331 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:19:07.229343 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:07.229961 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:07.236837 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:07.237259 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:07.237705 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:07.238417 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:07.238907 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:07.239340 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:07.377014 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:07.384521 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-effb66e2-f8b3-4f6a-9c21-ff25af505fe4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1655 microversion: 2.1 time: 0.159181 Aug 10 11:19:07.385077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 277/542] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:07 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:07.405904 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-90b9bfaf-1896-4128-ae0e-70bc94798099 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:07.413013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90b9bfaf-1896-4128-ae0e-70bc94798099 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:07.413496 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90b9bfaf-1896-4128-ae0e-70bc94798099 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:07.413927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90b9bfaf-1896-4128-ae0e-70bc94798099 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:07.435538 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-90b9bfaf-1896-4128-ae0e-70bc94798099 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Going to try to start instance {{(pid=117920) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 11:19:07.488203 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-90b9bfaf-1896-4128-ae0e-70bc94798099 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/action" status: 202 len: 0 microversion: 2.1 time: 0.085499 Aug 10 11:19:07.488743 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 266/543] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:19:07 2022] POST /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:19:07.497586 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:07.498023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:07.507216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:07.507716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:07.508212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:07.508944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:07.509679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:07.510334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:07.648358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:07.656461 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b7ec3163-c3cc-46e2-9762-90a20b70f037 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1664 microversion: 2.1 time: 0.163515 Aug 10 11:19:07.657030 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 278/544] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:07 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:07.755512 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:07.756156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:07.762109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:07.762621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:07.763057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:07.763741 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:07.764190 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:07.764610 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:07.780373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 HTTP/1.1 Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:19:07.781989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:19:07.784065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '43e362be-7551-4ab4-98ec-7920d5ca5d63'} Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:19:07.784818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:19:07.785984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:07.787138 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:19:07.787138 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8c22e87b-3a34-42fa-8dba-a01c4f1caa4f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 404 len: 111 microversion: 2.1 time: 0.033275 Aug 10 11:19:07.787138 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 267/545] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:07 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:19:07.792814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2e6dc8fd-12c4-4237-8956-1e4d9917c6cf tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '.version_select at 0x7fccf815d3a0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:07.816378 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2e6dc8fd-12c4-4237-8956-1e4d9917c6cf tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343507743" status: 202 len: 0 microversion: 2.1 time: 0.027222 Aug 10 11:19:07.816972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 279/546] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 10 11:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343507743 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:19:08.546088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:08.546663 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:08.552900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:08.553374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:08.553801 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:08.554479 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:08.554952 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:08.555369 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:08.557888 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:08.678351 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:08.678998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:08.679906 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lazy-loading 'services' on Instance uuid 416de879-4113-49f9-b2a9-04398bd17e4a {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:19:08.685955 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:08.686559 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:08.687154 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:08.687995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:08.688455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:08.689200 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:08.800558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3d4e2e4-813c-4fdb-81ad-e8b816d94ad8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments/d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2" status: 202 len: 0 microversion: 2.1 time: 0.258059 Aug 10 11:19:08.801611 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 268/547] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:19:08 2022] DELETE /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments/d1a2cb4f-ab36-41e9-9e70-a812f4ed61b2 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:19:08.809858 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1ad57b0e-35c2-4430-bed9-228a86bdd6e1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:08.812257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1ad57b0e-35c2-4430-bed9-228a86bdd6e1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:08.820363 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ad57b0e-35c2-4430-bed9-228a86bdd6e1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:08.820858 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ad57b0e-35c2-4430-bed9-228a86bdd6e1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:08.821301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ad57b0e-35c2-4430-bed9-228a86bdd6e1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:08.822013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ad57b0e-35c2-4430-bed9-228a86bdd6e1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:08.822470 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ad57b0e-35c2-4430-bed9-228a86bdd6e1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:08.823095 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ad57b0e-35c2-4430-bed9-228a86bdd6e1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:08.832188 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:08.839713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-25ffe478-4af5-4b95-b4f8-d283f94ae74e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1664 microversion: 2.1 time: 0.166282 Aug 10 11:19:08.840293 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 280/548] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:08 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:19:08.859467 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1ad57b0e-35c2-4430-bed9-228a86bdd6e1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053864 Aug 10 11:19:08.860026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 269/549] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:19:08 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:19:09.860883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:09.862069 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:09.868694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:09.869209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:09.869645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:09.870338 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:09.870823 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:09.871250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:09.872267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a040857d-f555-4c18-b4f9-37d7793e3ac0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:09.874411 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a040857d-f555-4c18-b4f9-37d7793e3ac0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:09.881042 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a040857d-f555-4c18-b4f9-37d7793e3ac0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:09.881540 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a040857d-f555-4c18-b4f9-37d7793e3ac0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:09.881970 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a040857d-f555-4c18-b4f9-37d7793e3ac0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:09.882778 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a040857d-f555-4c18-b4f9-37d7793e3ac0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:09.883154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a040857d-f555-4c18-b4f9-37d7793e3ac0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:09.883570 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a040857d-f555-4c18-b4f9-37d7793e3ac0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:09.912106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a040857d-f555-4c18-b4f9-37d7793e3ac0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Aug 10 11:19:09.912666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 270/550] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:19:09 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:19:10.003872 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:10.011385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-27ce0d8c-cada-4785-a75d-fa87437a26ff tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1668 microversion: 2.1 time: 0.154356 Aug 10 11:19:10.011953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 281/551] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:09 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:10.924711 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9bdf3a6b-112f-4379-804a-5f3037e29f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:10.926847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9bdf3a6b-112f-4379-804a-5f3037e29f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:10.933181 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bdf3a6b-112f-4379-804a-5f3037e29f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:10.933690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bdf3a6b-112f-4379-804a-5f3037e29f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:10.934116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bdf3a6b-112f-4379-804a-5f3037e29f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:10.934831 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bdf3a6b-112f-4379-804a-5f3037e29f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:10.935307 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bdf3a6b-112f-4379-804a-5f3037e29f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:10.935724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9bdf3a6b-112f-4379-804a-5f3037e29f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:10.963562 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9bdf3a6b-112f-4379-804a-5f3037e29f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043221 Aug 10 11:19:10.964100 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 271/552] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:19:10 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:19:11.023861 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:11.024332 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:11.030730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:11.031205 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:11.031636 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:11.032316 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:11.032761 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:11.033179 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:11.047818 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:11.058712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:19:11.129252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4836f0d0-b221-41e3-b8f5-9ca990c64f89 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 204 len: 0 microversion: 2.1 time: 0.108822 Aug 10 11:19:11.129750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 282/553] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:19:11 2022] DELETE /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:19:11.137874 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:11.138484 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:11.144973 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:11.145474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:11.145911 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:11.146621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:11.147077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:11.147516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:11.278996 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:11.286431 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e238ff14-481f-4954-814c-eb00bca4e1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1680 microversion: 2.1 time: 0.152475 Aug 10 11:19:11.287026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 272/554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:11 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:11.842636 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:11.843156 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:11.849629 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:11.850109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:11.850538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:11.851249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:11.851694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:11.852113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:11.876634 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:19:11.958140 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f3089cad-7037-4569-9472-84b2fbcc245b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "DELETE /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 204 len: 0 microversion: 2.1 time: 0.119527 Aug 10 11:19:11.958739 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 283/555] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:19:11 2022] DELETE /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:19:11.966729 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:11.967340 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:11.974269 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:11.974794 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:11.975231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:11.975919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:11.976371 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:11.976798 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:12.107720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:12.115125 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa3aebdf-4781-4131-b59d-7beecf22fe7e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1575 microversion: 2.1 time: 0.152249 Aug 10 11:19:12.115738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 273/556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:11 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:12.307794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:12.308501 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:12.315649 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:12.316109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:12.316545 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:12.317232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:12.317682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:12.318106 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:12.447968 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:12.456084 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b295504-605b-4cec-bfbc-a6dc34784d12 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1680 microversion: 2.1 time: 0.152628 Aug 10 11:19:12.456651 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 284/557] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:12 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:13.136451 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:13.136965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:13.144158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:13.144651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:13.145090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:13.145793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:13.146262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:13.146734 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:13.280858 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:13.288890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0a37cafa-e7be-49b7-8b90-c94b47144ae8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1575 microversion: 2.1 time: 0.156368 Aug 10 11:19:13.289455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 274/558] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:13 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:13.477098 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:13.477707 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:13.484139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:13.484623 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:13.485057 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:13.485746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:13.486722 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:13.487145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:13.615026 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:13.622888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-96982cd4-d55f-4978-bee6-1c322128e0fc tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1680 microversion: 2.1 time: 0.149500 Aug 10 11:19:13.623772 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 285/559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:13 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:14.309372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:14.309987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:14.318490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:14.319018 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:14.319459 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:14.329782 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:14.330746 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:14.331197 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:14.335034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5fb5cc22-38b1-46bc-b49a-13a07bb8341a req-c2c6cdef-99dd-43d7-b570-9338f61c9b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416de879-4113-49f9-b2a9-04398bd17e4a", "name": "network-vif-deleted", "tag": "9b7676b1-1e6e-4948-8893-e526c58468e0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:14.344403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5fb5cc22-38b1-46bc-b49a-13a07bb8341a req-c2c6cdef-99dd-43d7-b570-9338f61c9b6c service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:14.344895 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5fb5cc22-38b1-46bc-b49a-13a07bb8341a req-c2c6cdef-99dd-43d7-b570-9338f61c9b6c service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:14.345312 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5fb5cc22-38b1-46bc-b49a-13a07bb8341a req-c2c6cdef-99dd-43d7-b570-9338f61c9b6c service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:14.357485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5fb5cc22-38b1-46bc-b49a-13a07bb8341a req-c2c6cdef-99dd-43d7-b570-9338f61c9b6c service nova] Creating event network-vif-deleted:9b7676b1-1e6e-4948-8893-e526c58468e0 for instance 416de879-4113-49f9-b2a9-04398bd17e4a on hv-cinder-85272 Aug 10 11:19:14.363428 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5fb5cc22-38b1-46bc-b49a-13a07bb8341a req-c2c6cdef-99dd-43d7-b570-9338f61c9b6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032049 Aug 10 11:19:14.366952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 286/560] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:19:14.613502 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:14.629556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a6966beb-61a3-4e3b-a48d-5251826f244e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1575 microversion: 2.1 time: 0.324053 Aug 10 11:19:14.642907 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 275/561] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:14 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1575 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:14.643944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:14.644649 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:14.651353 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:14.652045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:14.652647 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:14.653543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:14.654183 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:14.654855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:14.687413 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:14.688420 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:14.689589 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:14.690276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lazy-loading 'fault' on Instance uuid 416de879-4113-49f9-b2a9-04398bd17e4a {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:19:14.765904 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:14.774018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1dd3fe1f-db5c-4a50-8b3e-376edc92b4ec tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 200 len: 1331 microversion: 2.1 time: 0.134162 Aug 10 11:19:14.774937 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 287/562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:14 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:19:15.368154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a493a797-97b1-42e5-891f-45ca36c2f187 req-ed2dc0a9-d428-40ed-816c-6899b7678cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628a87c3-fd0c-4dc9-928d-f3101ca70218", "name": "network-vif-deleted", "tag": "ca4e73e3-0761-49f5-89f4-b0d8ef602d71"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:15.380340 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a493a797-97b1-42e5-891f-45ca36c2f187 req-ed2dc0a9-d428-40ed-816c-6899b7678cda service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:15.381674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a493a797-97b1-42e5-891f-45ca36c2f187 req-ed2dc0a9-d428-40ed-816c-6899b7678cda service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:15.382297 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a493a797-97b1-42e5-891f-45ca36c2f187 req-ed2dc0a9-d428-40ed-816c-6899b7678cda service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:15.404788 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a493a797-97b1-42e5-891f-45ca36c2f187 req-ed2dc0a9-d428-40ed-816c-6899b7678cda service nova] Creating event network-vif-deleted:ca4e73e3-0761-49f5-89f4-b0d8ef602d71 for instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 on hv-cinder-85272 Aug 10 11:19:15.412838 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a493a797-97b1-42e5-891f-45ca36c2f187 req-ed2dc0a9-d428-40ed-816c-6899b7678cda service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050935 Aug 10 11:19:15.413500 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 276/563] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:19:15.652161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:15.652822 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:15.662678 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:15.663451 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:15.664071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:15.664797 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:15.665424 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:15.665860 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:15.745744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:15.755874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3b3e15e8-4ea6-4568-9697-ce1d02e59eb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 200 len: 1225 microversion: 2.1 time: 0.110053 Aug 10 11:19:15.757058 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 288/564] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:15 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:15.796174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:15.797219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:15.803428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:15.803914 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:15.804345 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:15.805032 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:15.805482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:15.805900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:15.820283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a HTTP/1.1 Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:19:15.822133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:19:15.823632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '416de879-4113-49f9-b2a9-04398bd17e4a'} Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:19:15.824414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:19:15.825804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:19:15.827692 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:19:15.828682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-75a88fcb-d8ac-44c0-a56b-ee256324b5c2 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 404 len: 111 microversion: 2.1 time: 0.036999 Aug 10 11:19:15.829804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 277/565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:15 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:19:15.838208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-672465e4-58c8-4b0d-8017-5016c6feb882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '.version_select at 0x7fccf377a040>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:15.874266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-672465e4-58c8-4b0d-8017-5016c6feb882 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021702183" status: 202 len: 0 microversion: 2.1 time: 0.040052 Aug 10 11:19:15.874957 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 289/566] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 10 11:19:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021702183 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:19:16.569323 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-188cfd7b-b39b-4735-864a-cdc8223cedfe tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: .version_select at 0x7fccf8050af0>, body: {"keypair": {"name": "tempest-keypair-143361916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrjC2aJrE4yAA4Eez2nb/nQt61jZVklbsrUgoL+grPKsLhO9Rkv4W4/u5vBZC4/SdKg/+7BtA7Uai26oRMJYAC4GU9j6CqqlTEBm+EcaFxevOKUS0LUNHbojq7v6f19jg=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:16.584699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-188cfd7b-b39b-4735-864a-cdc8223cedfe tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:19:16.588448 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-188cfd7b-b39b-4735-864a-cdc8223cedfe tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for user 0a30897a10d8467aa294f24954368a84 and project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:19:16.613034 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-188cfd7b-b39b-4735-864a-cdc8223cedfe tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047538 Aug 10 11:19:16.614013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 278/567] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:19:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:19:16.776780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:16.777513 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:16.784252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:16.784832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:16.785379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:16.786138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:16.786688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:16.787191 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:16.801399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] HTTP exception thrown: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Request method failure captured: Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 HTTP/1.1 Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85M_psov25eGkkzyQMHoyYW54vN061TczfwlTdEd2tI7nV2katGozn03Y_YaYa2b2M7JoUUvoImt9o4PHTF2k6102p3uSEC0tbNyoHmECmZi9m7aPtgvdqmynIF7lJgReV8KIHlQSW_do_7An07mt-0Qlddso2oLCRaka3gDMJyC6Uc Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:19:16.803222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 7ebc052a3cb6400a961c1b9d9bec83d6 Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:19:16.804750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '628a87c3-fd0c-4dc9-928d-f3101ca70218'} Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:19:16.805657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:19:16.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:19:16.808452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Returning 404 to user: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:19:16.808452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-711485fa-f832-44c1-b4e6-7bd59a43bc2d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 404 len: 111 microversion: 2.1 time: 0.033340 Aug 10 11:19:16.808452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 290/568] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:16 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:19:16.920993 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-212133436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800106665", "security_groups": [{"name": "tempest-secgroup-smoke-874089438"}], "block_device_mapping_v2": [{"uuid": "edcf5b47-0958-4fa6-baf0-0d7c688e4145", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6731bf27-4e34-48cb-9d42-c4bbb5a3efbd"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:17.035080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] validate_networks() for [('6731bf27-4e34-48cb-9d42-c4bbb5a3efbd', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:19:17.673063 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:19:17.673704 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:19:17.673960 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:19:17.674405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:19:17.675018 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:19:17.683905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:17.684420 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:17.685466 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:17.686374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:17.687094 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:17.687530 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:17.705762 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Getting quotas for project 79389800e0ea49d3b5abfbefe17960ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:19:17.710201 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Getting quotas for user 7ebc052a3cb6400a961c1b9d9bec83d6 and project 79389800e0ea49d3b5abfbefe17960ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:19:17.768370 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:19:17.770447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edcf5b47-0958-4fa6-baf0-0d7c688e4145',volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:19:17.906043 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d67e1c18-73d6-4b02-8ac9-aee56bb929ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.988818 Aug 10 11:19:17.906946 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 279/569] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:19:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:19:17.918135 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-36ef8706-08b2-4dd2-8683-444b910a24b9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:17.919457 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-36ef8706-08b2-4dd2-8683-444b910a24b9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:17.983375 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-36ef8706-08b2-4dd2-8683-444b910a24b9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:17.992398 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-36ef8706-08b2-4dd2-8683-444b910a24b9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1093 microversion: 2.1 time: 0.078067 Aug 10 11:19:17.992967 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 291/570] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:17 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:18.098522 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-212333816", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7551c29-e5c9-4c19-8306-42621bf3d395"}], "security_groups": [{"name": "tempest-securitygroup--1797179077"}], "key_name": "tempest-keypair-143361916", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:18.205866 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] validate_networks() for [('b7551c29-e5c9-4c19-8306-42621bf3d395', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:19:18.582382 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:19:18.582842 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:19:18.583314 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:19:18.583718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:19:18.584127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:19:18.594691 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:18.595172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:18.595646 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:18.597189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:18.597649 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:18.598158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:18.618523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:19:18.622213 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for user 0a30897a10d8467aa294f24954368a84 and project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:19:18.633071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:19:18.635276 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:19:18.680101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf288057-b77d-4b13-9114-89c3901c818a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586423 Aug 10 11:19:18.681027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 280/571] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:19:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:19:18.691819 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-78ba230b-da0a-4248-a179-ed0a6a767902 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:18.692553 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-78ba230b-da0a-4248-a179-ed0a6a767902 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:18.746842 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-78ba230b-da0a-4248-a179-ed0a6a767902 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:18.754094 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-78ba230b-da0a-4248-a179-ed0a6a767902 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1240 microversion: 2.1 time: 0.066410 Aug 10 11:19:18.754672 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 292/572] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:18 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:19:19.014241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:19.014894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:19.022368 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:19.022919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:19.023361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:19.024226 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:19.024845 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:19.025433 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:19.109963 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:19.121308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e7e340f2-6b40-4407-b85f-a0a0f2504842 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1199 microversion: 2.1 time: 0.110776 Aug 10 11:19:19.122739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 281/573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:19 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:19.775331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:19.776045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:19.806368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:19.806836 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:19.807800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:19.809139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:19.809599 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:19.810025 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:19.928815 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:19.946632 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-680ba43c-123c-4655-9e95-ab0464911d31 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1292 microversion: 2.1 time: 0.175476 Aug 10 11:19:19.963163 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 293/574] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:19 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1292 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:20.143559 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:20.144227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:20.150694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:20.151187 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:20.151625 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:20.152384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:20.152864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:20.153275 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:20.345112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:20.353739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-38458976-abab-4d94-8cf9-4367237c5192 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.214056 Aug 10 11:19:20.354419 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 282/575] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:20 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:20.565951 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-f9a79334-3c85-4b56-9c0c-2ade96ea3fdd req-6fefa3e4-ea17-48fb-9441-90b596cc27b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baed2b16-01ed-46c4-a01b-03f8ef8d6db3", "tag": "e81e1b57-8c3b-4a61-84eb-cefb848af8f3"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:20.578267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-f9a79334-3c85-4b56-9c0c-2ade96ea3fdd req-6fefa3e4-ea17-48fb-9441-90b596cc27b7 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:20.579751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-f9a79334-3c85-4b56-9c0c-2ade96ea3fdd req-6fefa3e4-ea17-48fb-9441-90b596cc27b7 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:20.580917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-f9a79334-3c85-4b56-9c0c-2ade96ea3fdd req-6fefa3e4-ea17-48fb-9441-90b596cc27b7 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:20.593990 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-f9a79334-3c85-4b56-9c0c-2ade96ea3fdd req-6fefa3e4-ea17-48fb-9441-90b596cc27b7 service nova] Creating event network-changed:e81e1b57-8c3b-4a61-84eb-cefb848af8f3 for instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 on hv-cinder-85272 Aug 10 11:19:20.598948 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-f9a79334-3c85-4b56-9c0c-2ade96ea3fdd req-6fefa3e4-ea17-48fb-9441-90b596cc27b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037819 Aug 10 11:19:20.599744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 294/576] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:19:20.993418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:20.994926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:21.001678 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:21.003770 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:21.004383 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:21.005110 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:21.005720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:21.006148 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:21.210184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:21.217597 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bad643bc-d43d-4436-9a83-153fcdf46e48 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.227964 Aug 10 11:19:21.218162 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 283/577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:20 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:21.375848 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:21.376672 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:21.382883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:21.383362 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:21.383795 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:21.384489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:21.384940 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:21.385360 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:21.521086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:21.528506 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6fdba4ab-b14c-48b0-a4bf-24e15cae6fd8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.157333 Aug 10 11:19:21.529076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 295/578] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:21 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:21.561910 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-658d4d4b-8c8c-4f06-b133-fc02e06a5cf6 req-4a880d10-d3ac-4cc6-8b34-7173803910e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8547aa0-1882-4f7e-8f8c-971de45eb907", "tag": "6b9a2d77-fe7a-40a8-add0-b53ef8501f4b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:21.571424 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-658d4d4b-8c8c-4f06-b133-fc02e06a5cf6 req-4a880d10-d3ac-4cc6-8b34-7173803910e0 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:21.571901 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-658d4d4b-8c8c-4f06-b133-fc02e06a5cf6 req-4a880d10-d3ac-4cc6-8b34-7173803910e0 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:21.572328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-658d4d4b-8c8c-4f06-b133-fc02e06a5cf6 req-4a880d10-d3ac-4cc6-8b34-7173803910e0 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:21.583562 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-658d4d4b-8c8c-4f06-b133-fc02e06a5cf6 req-4a880d10-d3ac-4cc6-8b34-7173803910e0 service nova] Creating event network-changed:6b9a2d77-fe7a-40a8-add0-b53ef8501f4b for instance f8547aa0-1882-4f7e-8f8c-971de45eb907 on hv-cinder-85272 Aug 10 11:19:21.588433 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-658d4d4b-8c8c-4f06-b133-fc02e06a5cf6 req-4a880d10-d3ac-4cc6-8b34-7173803910e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030294 Aug 10 11:19:21.589175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 284/579] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:19:22.239612 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:22.240506 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:22.247615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:22.248343 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:22.248776 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:22.249473 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:22.249949 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:22.250367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:22.495013 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:22.506221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-09135132-7881-4d12-ba7d-217a8ac4b098 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.270901 Aug 10 11:19:22.520070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 296/580] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:22 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:22.551125 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:22.551824 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:22.553867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:22.559478 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:22.559967 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:22.560399 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:22.561095 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:22.561544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:22.561965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:22.799654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:22.807394 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb81a45e-bb63-463c-8951-62ba5c71f230 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.260944 Aug 10 11:19:22.808141 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 285/581] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:22 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:23.526817 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:23.527426 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:23.533736 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:23.534213 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:23.534667 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:23.535347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:23.535795 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:23.536212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:23.661080 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:23.669063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c02e09b5-4758-4025-bd90-ebcb26e88eaa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.146155 Aug 10 11:19:23.669626 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 297/582] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:23 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:23.828211 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:23.828738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:23.835573 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:23.836050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:23.836508 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:23.837186 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:23.837630 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:23.838048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:23.963931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:23.971867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-756ad65d-3fc2-4480-896d-6d697bbe3666 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.147527 Aug 10 11:19:23.972425 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 286/583] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:23 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:24.689718 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:24.690349 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:24.697772 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:24.698284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:24.698804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:24.699508 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:24.699962 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:24.700385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:24.830876 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:24.838183 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2f9b33e3-e290-4318-95a9-80c2212dd023 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.152579 Aug 10 11:19:24.838794 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 298/584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:24 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:24.992418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:24.993024 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:24.999373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:24.999854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:25.000285 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:25.000968 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:25.001423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:25.001841 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:25.128549 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:25.136001 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0fa46f51-7363-460a-b47f-b74e9f0bfadc tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.147358 Aug 10 11:19:25.136581 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 287/585] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:24 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:25.859282 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:25.859985 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:25.867426 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:25.867527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:25.867944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:25.868640 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:25.869092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:25.869518 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:25.999665 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:26.007354 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c342a607-9dde-48f5-b4c2-f19d15f93764 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.151926 Aug 10 11:19:26.007917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 299/586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:25 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:26.156250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:26.156799 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:26.163858 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:26.164490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:26.164933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:26.165636 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:26.166098 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:26.166528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:26.180787 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:26.293837 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:26.301221 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c083ab93-0f73-4ac4-8df3-51a91e01f01c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.148839 Aug 10 11:19:26.301775 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 288/587] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:26 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:27.027671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:27.028283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:27.034718 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:27.035201 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:27.035642 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:27.036330 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:27.036779 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:27.037198 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:27.051786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:27.167709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:27.175064 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ff9564e7-a9b6-4c29-92da-9e83538bd1a9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.151269 Aug 10 11:19:27.175633 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 300/588] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:27 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:27.322012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:27.322649 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:27.329328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:27.329818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:27.330863 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:27.331573 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:27.332028 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:27.332468 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:27.467094 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:27.474384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f24400a3-ef41-4666-b1c2-e4a8288492b4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.156308 Aug 10 11:19:27.475001 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 289/589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:27 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:28.195830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:28.196467 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:28.202924 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:28.203407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:28.203844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:28.204528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:28.205466 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:28.205916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:28.333599 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:28.341046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1a716361-85c4-4241-b715-0fc2cac56f17 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.149039 Aug 10 11:19:28.341601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 301/590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:28 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:28.551006 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:28.551562 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:28.557925 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:28.558413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:28.558882 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:28.559579 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:28.560034 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:28.560460 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:28.607727 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:28.628345 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=16 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:28.694867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:28.707309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d48fa19b-0cca-4b68-8714-7f232eac0cbd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.160049 Aug 10 11:19:28.707919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 290/591] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:28 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:29.363108 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:29.363712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:29.365560 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:29.371103 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:29.371582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:29.372010 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:29.372690 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:29.373135 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:29.373555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:29.496594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:29.504376 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-29b6d3a6-2c07-4b17-89e9-b87b670ad58f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.145686 Aug 10 11:19:29.504942 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 302/592] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:29 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:29.728260 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:29.728789 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:29.735397 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:29.735890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:29.736319 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:29.737022 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:29.737474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:29.737893 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:29.873331 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:29.882025 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4dd574bb-b90d-4893-9ffd-29ea6011bade tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.157762 Aug 10 11:19:29.882596 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 291/593] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:29 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:30.034137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-e750f172-80ea-441e-b554-44bba61262b0 req-7ead62af-e420-40de-872f-bb1aba14edec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8547aa0-1882-4f7e-8f8c-971de45eb907", "name": "network-vif-plugged", "status": "completed", "tag": "6b9a2d77-fe7a-40a8-add0-b53ef8501f4b"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:30.043567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e750f172-80ea-441e-b554-44bba61262b0 req-7ead62af-e420-40de-872f-bb1aba14edec service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:30.044049 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e750f172-80ea-441e-b554-44bba61262b0 req-7ead62af-e420-40de-872f-bb1aba14edec service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:30.044512 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e750f172-80ea-441e-b554-44bba61262b0 req-7ead62af-e420-40de-872f-bb1aba14edec service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:30.058385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-e750f172-80ea-441e-b554-44bba61262b0 req-7ead62af-e420-40de-872f-bb1aba14edec service nova] Creating event network-vif-plugged:6b9a2d77-fe7a-40a8-add0-b53ef8501f4b for instance f8547aa0-1882-4f7e-8f8c-971de45eb907 on hv-cinder-85272 Aug 10 11:19:30.063308 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-e750f172-80ea-441e-b554-44bba61262b0 req-7ead62af-e420-40de-872f-bb1aba14edec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033512 Aug 10 11:19:30.064009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 303/594] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:19:30.525367 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:30.525971 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:30.531938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:30.532418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:30.532848 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:30.533525 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:30.533974 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:30.534393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:30.659236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:30.667877 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c727180d-41b7-4233-b379-e67025c48975 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.146563 Aug 10 11:19:30.668455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 292/595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:30 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:30.903358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:30.904063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:30.910671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:30.911152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:30.911587 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:30.912267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:30.912717 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:30.913138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:31.042367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:31.050387 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-aa6a20a9-46e8-4d76-aec1-75a2f3a5cb75 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.151664 Aug 10 11:19:31.050983 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 304/596] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:30 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:31.689890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:31.690541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:31.696445 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:31.696927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:31.697370 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:31.698057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:31.698517 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:31.698970 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:31.824522 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:31.832440 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-88a0e71b-374b-4bfd-98fb-11e5da04f9b8 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1366 microversion: 2.1 time: 0.147237 Aug 10 11:19:31.833006 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 293/597] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:31 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:32.071432 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:32.072056 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:32.078765 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:32.079468 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:32.080189 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:32.080985 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:32.081504 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:32.082126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:32.107354 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-461ba110-19ef-4d64-8b82-8b6003b507e0 req-64c44a27-162d-48a2-96dc-bcc90267738c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baed2b16-01ed-46c4-a01b-03f8ef8d6db3", "name": "network-vif-plugged", "status": "completed", "tag": "e81e1b57-8c3b-4a61-84eb-cefb848af8f3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:32.118389 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-461ba110-19ef-4d64-8b82-8b6003b507e0 req-64c44a27-162d-48a2-96dc-bcc90267738c service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:32.118945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-461ba110-19ef-4d64-8b82-8b6003b507e0 req-64c44a27-162d-48a2-96dc-bcc90267738c service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:32.119477 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-461ba110-19ef-4d64-8b82-8b6003b507e0 req-64c44a27-162d-48a2-96dc-bcc90267738c service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:32.132597 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-461ba110-19ef-4d64-8b82-8b6003b507e0 req-64c44a27-162d-48a2-96dc-bcc90267738c service nova] Creating event network-vif-plugged:e81e1b57-8c3b-4a61-84eb-cefb848af8f3 for instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 on hv-cinder-85272 Aug 10 11:19:32.138128 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-461ba110-19ef-4d64-8b82-8b6003b507e0 req-64c44a27-162d-48a2-96dc-bcc90267738c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034538 Aug 10 11:19:32.138925 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 294/598] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:19:32.216921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:32.224286 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a34950e3-a1ef-423f-b4fe-390fa0405ae4 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.156967 Aug 10 11:19:32.224844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 305/599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:32 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:32.853803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:32.855241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:32.861919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:32.862415 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:32.862934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:32.863641 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:32.864103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:32.864629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:32.998600 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:33.006478 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d416b5a2-63bf-4276-b35d-d143971a7008 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1555 microversion: 2.1 time: 0.157272 Aug 10 11:19:33.007079 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 295/600] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:32 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:33.026641 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9b9bf1fe-daf3-47b4-84a6-cee1be5d7faa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:33.027134 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9b9bf1fe-daf3-47b4-84a6-cee1be5d7faa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:33.029122 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:33.035208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b9bf1fe-daf3-47b4-84a6-cee1be5d7faa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:33.035681 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b9bf1fe-daf3-47b4-84a6-cee1be5d7faa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:33.036111 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b9bf1fe-daf3-47b4-84a6-cee1be5d7faa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:33.036788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b9bf1fe-daf3-47b4-84a6-cee1be5d7faa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:33.037233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b9bf1fe-daf3-47b4-84a6-cee1be5d7faa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:33.037648 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b9bf1fe-daf3-47b4-84a6-cee1be5d7faa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:33.116332 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9b9bf1fe-daf3-47b4-84a6-cee1be5d7faa tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093466 Aug 10 11:19:33.116949 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 306/601] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 11:19:33 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:19:33.244400 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:33.245019 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:33.250967 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:33.251459 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:33.252027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:33.252732 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:33.253195 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:33.253627 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:33.716786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:33.724238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5f3c1ae0-f1b6-4a8d-813a-5a57f691e049 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1264 microversion: 2.1 time: 0.483771 Aug 10 11:19:33.724814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 296/602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:33 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1264 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:34.347619 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-3cbfa71d-111f-4942-881e-8c44acd69410 req-9dc00cce-4ecf-4a5c-8e6d-96cc1a03d4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8547aa0-1882-4f7e-8f8c-971de45eb907", "tag": "6b9a2d77-fe7a-40a8-add0-b53ef8501f4b"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:34.358202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-3cbfa71d-111f-4942-881e-8c44acd69410 req-9dc00cce-4ecf-4a5c-8e6d-96cc1a03d4b6 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:34.358807 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-3cbfa71d-111f-4942-881e-8c44acd69410 req-9dc00cce-4ecf-4a5c-8e6d-96cc1a03d4b6 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:34.359326 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-3cbfa71d-111f-4942-881e-8c44acd69410 req-9dc00cce-4ecf-4a5c-8e6d-96cc1a03d4b6 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:34.373116 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-3cbfa71d-111f-4942-881e-8c44acd69410 req-9dc00cce-4ecf-4a5c-8e6d-96cc1a03d4b6 service nova] Creating event network-changed:6b9a2d77-fe7a-40a8-add0-b53ef8501f4b for instance f8547aa0-1882-4f7e-8f8c-971de45eb907 on hv-cinder-85272 Aug 10 11:19:34.378558 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-3cbfa71d-111f-4942-881e-8c44acd69410 req-9dc00cce-4ecf-4a5c-8e6d-96cc1a03d4b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036016 Aug 10 11:19:34.379697 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 307/603] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:19:34.744519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:34.745240 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:34.751646 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:34.752626 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:34.753062 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:34.753767 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:34.754229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:34.754683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:34.888646 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:34.896674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0465c364-b134-4058-861b-52761920a47a tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1450 microversion: 2.1 time: 0.156068 Aug 10 11:19:34.897238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 297/604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:34 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:34.916919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:34.917613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:34.924238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:34.924722 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:34.925152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:34.925830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:34.926271 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:34.926712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:35.061379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:35.070108 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e914ceac-1d69-4b84-98ae-a2e4b9e1278d tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1450 microversion: 2.1 time: 0.157256 Aug 10 11:19:35.070806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 308/605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:34 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:36.696500 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-0f2257ff-65af-401f-a72e-9e07c794cd08 req-a643c45a-81bf-4273-9b0e-f9da254e4ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baed2b16-01ed-46c4-a01b-03f8ef8d6db3", "tag": "e81e1b57-8c3b-4a61-84eb-cefb848af8f3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:19:36.706267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0f2257ff-65af-401f-a72e-9e07c794cd08 req-a643c45a-81bf-4273-9b0e-f9da254e4ea4 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:36.706852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0f2257ff-65af-401f-a72e-9e07c794cd08 req-a643c45a-81bf-4273-9b0e-f9da254e4ea4 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:36.707288 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0f2257ff-65af-401f-a72e-9e07c794cd08 req-a643c45a-81bf-4273-9b0e-f9da254e4ea4 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:36.718203 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0f2257ff-65af-401f-a72e-9e07c794cd08 req-a643c45a-81bf-4273-9b0e-f9da254e4ea4 service nova] Creating event network-changed:e81e1b57-8c3b-4a61-84eb-cefb848af8f3 for instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 on hv-cinder-85272 Aug 10 11:19:36.723027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-0f2257ff-65af-401f-a72e-9e07c794cd08 req-a643c45a-81bf-4273-9b0e-f9da254e4ea4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030216 Aug 10 11:19:36.723629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 298/606] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:19:54.443666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:54.444170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:54.446426 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=5 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:54.447123 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=41 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:54.452570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:54.453056 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:54.453494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:54.454185 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:54.454668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:54.455106 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:54.532745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lazy-loading 'services' on Instance uuid 6452d7fb-2373-409c-81fe-2c67626068ae {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:19:54.601578 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2ef7e0a3-8894-43b1-83b3-97c8aa43685d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments/bf1acf0f-6d61-4d1d-bc46-76a37e21aa00" status: 202 len: 0 microversion: 2.1 time: 0.162677 Aug 10 11:19:54.602154 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 309/607] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:19:54 2022] DELETE /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments/bf1acf0f-6d61-4d1d-bc46-76a37e21aa00 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:19:54.608230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=27 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:54.609098 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=55 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:54.613787 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bb06733-67fe-419d-929d-740a2c065834 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:54.616040 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1bb06733-67fe-419d-929d-740a2c065834 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:54.622916 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb06733-67fe-419d-929d-740a2c065834 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:54.623641 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb06733-67fe-419d-929d-740a2c065834 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:54.627570 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb06733-67fe-419d-929d-740a2c065834 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:54.628523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb06733-67fe-419d-929d-740a2c065834 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:54.629162 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb06733-67fe-419d-929d-740a2c065834 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:54.629933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb06733-67fe-419d-929d-740a2c065834 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:54.658876 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1bb06733-67fe-419d-929d-740a2c065834 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052057 Aug 10 11:19:54.659339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 299/608] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:19:54 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:19:55.672527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-98468441-4cc5-4897-9693-0f5f3d18c480 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:55.675469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-98468441-4cc5-4897-9693-0f5f3d18c480 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:55.681724 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98468441-4cc5-4897-9693-0f5f3d18c480 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:55.682207 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98468441-4cc5-4897-9693-0f5f3d18c480 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:55.682666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98468441-4cc5-4897-9693-0f5f3d18c480 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:55.683360 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98468441-4cc5-4897-9693-0f5f3d18c480 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:55.683814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98468441-4cc5-4897-9693-0f5f3d18c480 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:55.684239 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98468441-4cc5-4897-9693-0f5f3d18c480 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:55.712910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-98468441-4cc5-4897-9693-0f5f3d18c480 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Aug 10 11:19:55.713456 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 310/609] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:19:55 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:19:56.725069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3711e2b0-415e-4cfb-a415-455696672704 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:56.727207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3711e2b0-415e-4cfb-a415-455696672704 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:56.733475 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3711e2b0-415e-4cfb-a415-455696672704 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:56.733959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3711e2b0-415e-4cfb-a415-455696672704 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:56.734390 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3711e2b0-415e-4cfb-a415-455696672704 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:56.735104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3711e2b0-415e-4cfb-a415-455696672704 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:56.735551 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3711e2b0-415e-4cfb-a415-455696672704 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:56.735975 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3711e2b0-415e-4cfb-a415-455696672704 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:56.764134 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3711e2b0-415e-4cfb-a415-455696672704 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042996 Aug 10 11:19:56.764669 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 300/610] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:19:56 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:19:56.849180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:56.849696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:56.856060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:56.856541 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:56.856975 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:56.857663 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:56.858113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:56.858534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:56.884272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:19:56.956557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-25f5ee60-38c1-4447-809b-78afe647ef9d tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 204 len: 0 microversion: 2.1 time: 0.110876 Aug 10 11:19:56.957247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 311/611] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:19:56 2022] DELETE /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:19:56.965404 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:56.966014 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:56.972516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:56.972999 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:56.973435 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:56.974126 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:56.974606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:56.975037 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:57.102480 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:57.109877 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a407ea59-e8a8-4427-8bf8-ae225a1aecdd tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1688 microversion: 2.1 time: 0.148249 Aug 10 11:19:57.110623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 301/612] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:56 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:58.132134 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:58.132780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:58.139144 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:58.139623 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:58.140054 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:58.140737 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:58.141339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:58.141768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:58.267550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:58.275536 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-89b252a0-c871-4baf-b992-0f0bdf57c4c4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1688 microversion: 2.1 time: 0.147703 Aug 10 11:19:58.276105 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 312/613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:58 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:19:59.296454 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:19:59.297057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:19:59.304138 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:59.304616 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:59.305046 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:59.305729 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:19:59.306179 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:19:59.306643 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:19:59.435965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:19:59.444316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc8ae265-000d-4b30-b856-89750340c8e1 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1688 microversion: 2.1 time: 0.151679 Aug 10 11:19:59.444886 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 302/614] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:19:59 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:00.465257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:00.465852 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:00.472321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:00.472809 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:00.473248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:00.473941 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:00.474396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:00.474851 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:00.602758 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:00.610304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4c1df0da-8fac-4a27-9c3e-eb3e7120a74a tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1688 microversion: 2.1 time: 0.148958 Aug 10 11:20:00.610899 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 313/615] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:00 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:01.631700 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:01.632416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:01.638593 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:01.639146 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:01.639698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:01.640452 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:01.640974 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:01.641464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:01.713298 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:01.720804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-475ba8f4-b1c3-4c24-b601-bafab59d3f9e tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 200 len: 1622 microversion: 2.1 time: 0.093496 Aug 10 11:20:01.721303 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 303/616] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:01 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 1622 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:01.821654 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-f2400d16-24ef-481e-843d-7a50d55f939b req-ef948b1b-a66c-49d2-a3c5-b01593bc0bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6452d7fb-2373-409c-81fe-2c67626068ae", "name": "network-vif-deleted", "tag": "915bfc88-7f55-43d7-b302-6e13fb3394a5"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:01.832656 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-f2400d16-24ef-481e-843d-7a50d55f939b req-ef948b1b-a66c-49d2-a3c5-b01593bc0bb7 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:01.833177 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-f2400d16-24ef-481e-843d-7a50d55f939b req-ef948b1b-a66c-49d2-a3c5-b01593bc0bb7 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:01.833967 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-f2400d16-24ef-481e-843d-7a50d55f939b req-ef948b1b-a66c-49d2-a3c5-b01593bc0bb7 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:01.869326 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-f2400d16-24ef-481e-843d-7a50d55f939b req-ef948b1b-a66c-49d2-a3c5-b01593bc0bb7 service nova] Creating event network-vif-deleted:915bfc88-7f55-43d7-b302-6e13fb3394a5 for instance 6452d7fb-2373-409c-81fe-2c67626068ae on hv-cinder-85272 Aug 10 11:20:01.875726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-f2400d16-24ef-481e-843d-7a50d55f939b req-ef948b1b-a66c-49d2-a3c5-b01593bc0bb7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057671 Aug 10 11:20:01.877077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 314/617] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:02.741680 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:02.742300 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 6452d7fb-2373-409c-81fe-2c67626068ae] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:02.748955 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:02.749444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:02.749875 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:02.750585 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:02.751044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:02.751467 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:02.765263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] HTTP exception thrown: Instance 6452d7fb-2373-409c-81fe-2c67626068ae could not be found. Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Request method failure captured: Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae HTTP/1.1 Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85K2E2Wrim3-FxJMDYkkzQ_TMt5XzYbkWrEXOnPp9f0n4bCiKVg5CauNkfwdqiV0X33kGX_Mxw_UEozhsObEyrl7sEgn5MXwNG1VgK0TxGl-tvYd7MgLVE2Sx7DPXAFidcuR5kUzdLm67tAihNIGsOEgKSQHtJi9BHRYLOrW4INPUEk Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:20:02.767069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 5d1368fb915444b599b3fcf3f5586789 Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 6452d7fb-2373-409c-81fe-2c67626068ae could not be found. Aug 10 11:20:02.768624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '6452d7fb-2373-409c-81fe-2c67626068ae'} Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6452d7fb-2373-409c-81fe-2c67626068ae could not be found. Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:20:02.769387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6452d7fb-2373-409c-81fe-2c67626068ae could not be found. Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6452d7fb-2373-409c-81fe-2c67626068ae could not be found. Aug 10 11:20:02.771361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:02.772496 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Returning 404 to user: Instance 6452d7fb-2373-409c-81fe-2c67626068ae could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:20:02.772496 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-45e988b7-b78d-4a3f-a39a-a34799603423 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae" status: 404 len: 111 microversion: 2.1 time: 0.030695 Aug 10 11:20:02.772496 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 304/618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:02 2022] GET /compute/v2.1/servers/6452d7fb-2373-409c-81fe-2c67626068ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:20:02.778407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0b7223ea-d7d1-4ee6-bfe0-5b954d0548b0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '.version_select at 0x7fccf80c1af0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:02.796682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0b7223ea-d7d1-4ee6-bfe0-5b954d0548b0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224403454" status: 202 len: 0 microversion: 2.1 time: 0.022419 Aug 10 11:20:02.797255 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 315/619] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 10 11:20:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224403454 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:20:04.396699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0619183f-3925-4583-bc64-64751846192c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:04.397264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0619183f-3925-4583-bc64-64751846192c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:04.403331 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0619183f-3925-4583-bc64-64751846192c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:04.403813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0619183f-3925-4583-bc64-64751846192c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:04.404245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0619183f-3925-4583-bc64-64751846192c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:04.404926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0619183f-3925-4583-bc64-64751846192c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:04.405377 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0619183f-3925-4583-bc64-64751846192c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:04.405826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0619183f-3925-4583-bc64-64751846192c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:04.434322 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0619183f-3925-4583-bc64-64751846192c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments/7bb16c6d-1531-462c-9583-01afc043e61d" status: 200 len: 194 microversion: 2.20 time: 0.142030 Aug 10 11:20:04.434911 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 305/620] 10.222.0.49 () {60 vars in 1454 bytes} [Wed Aug 10 11:20:04 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments/7bb16c6d-1531-462c-9583-01afc043e61d => generated 194 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:20:04.500771 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:04.501380 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:04.510526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:04.511026 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:04.511455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:04.512143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:04.512589 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:04.513012 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:04.591543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lazy-loading 'services' on Instance uuid 2ee85970-24fd-4e03-9c90-460c66ab82e9 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:20:04.661770 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cae78cb6-013a-4190-8715-643f78b01a89 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments/7bb16c6d-1531-462c-9583-01afc043e61d" status: 202 len: 0 microversion: 2.20 time: 0.165330 Aug 10 11:20:04.662349 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 316/621] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 10 11:20:04 2022] DELETE /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments/7bb16c6d-1531-462c-9583-01afc043e61d => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:20:04.671731 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-352aeb7c-3c53-46ea-8011-0c6d2dc1b25e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:04.673987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-352aeb7c-3c53-46ea-8011-0c6d2dc1b25e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:04.680356 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352aeb7c-3c53-46ea-8011-0c6d2dc1b25e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:04.680939 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352aeb7c-3c53-46ea-8011-0c6d2dc1b25e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:04.681371 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352aeb7c-3c53-46ea-8011-0c6d2dc1b25e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:04.682096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352aeb7c-3c53-46ea-8011-0c6d2dc1b25e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:04.682692 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352aeb7c-3c53-46ea-8011-0c6d2dc1b25e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:04.683731 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-352aeb7c-3c53-46ea-8011-0c6d2dc1b25e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:04.714843 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-352aeb7c-3c53-46ea-8011-0c6d2dc1b25e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047797 Aug 10 11:20:04.715398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 306/622] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 11:20:04 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:20:05.728286 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6e976594-1d01-4c8b-8071-25cdb3b334ac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:05.730602 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6e976594-1d01-4c8b-8071-25cdb3b334ac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:05.737223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e976594-1d01-4c8b-8071-25cdb3b334ac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:05.737696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e976594-1d01-4c8b-8071-25cdb3b334ac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:05.738120 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e976594-1d01-4c8b-8071-25cdb3b334ac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:05.738824 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e976594-1d01-4c8b-8071-25cdb3b334ac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:05.739271 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e976594-1d01-4c8b-8071-25cdb3b334ac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:05.739698 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6e976594-1d01-4c8b-8071-25cdb3b334ac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:05.768078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6e976594-1d01-4c8b-8071-25cdb3b334ac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044526 Aug 10 11:20:05.768613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 317/623] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 11:20:05 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:20:05.896123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:05.896616 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:05.902869 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:05.903349 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:05.903777 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:05.904462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:05.904912 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:05.905333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:05.929565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:20:06.009161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a21f6b6c-8b3f-48c1-af76-1dc50e44ada8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 204 len: 0 microversion: 2.1 time: 0.116428 Aug 10 11:20:06.010209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 307/624] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:20:05 2022] DELETE /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:20:06.019084 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:06.019788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:06.026210 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:06.026746 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:06.027181 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:06.027870 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:06.028321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:06.028743 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:06.155719 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:06.163269 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e2162b63-3517-449f-b7c5-ba740682e7a7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1505 microversion: 2.1 time: 0.149142 Aug 10 11:20:06.163879 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 318/625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:06 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:06.781157 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5c3c398-f70b-4ca1-b4ca-ab190aa90dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:06.783871 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5c3c398-f70b-4ca1-b4ca-ab190aa90dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:06.789718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c3c398-f70b-4ca1-b4ca-ab190aa90dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:06.790200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c3c398-f70b-4ca1-b4ca-ab190aa90dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:06.790662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c3c398-f70b-4ca1-b4ca-ab190aa90dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:06.791353 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c3c398-f70b-4ca1-b4ca-ab190aa90dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:06.791803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c3c398-f70b-4ca1-b4ca-ab190aa90dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:06.792224 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c3c398-f70b-4ca1-b4ca-ab190aa90dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:06.821283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5c3c398-f70b-4ca1-b4ca-ab190aa90dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044611 Aug 10 11:20:06.821826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 308/626] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 11:20:06 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:06.883122 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:06.883860 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:06.893342 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:06.893827 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:06.894268 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:06.895008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:06.895461 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:06.895894 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:06.922192 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:20:07.003715 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8c86610f-c8cf-4b5f-9c56-705297c5a0db tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 204 len: 0 microversion: 2.20 time: 0.124764 Aug 10 11:20:07.004209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 319/627] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 10 11:20:06 2022] DELETE /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 11:20:07.012638 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:07.013273 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:07.020242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:07.020724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:07.021155 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:07.021847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:07.022296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:07.022747 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:07.185041 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:07.185909 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:07.192161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:07.192750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:07.193195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:07.193890 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:07.194344 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:07.194804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:07.293393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:07.301277 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:07.302876 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:07.304052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9cfffd2d-7c87-4995-ba65-5fbc7c31e0a9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.295319 Aug 10 11:20:07.304623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 309/628] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:07 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:20:07.434958 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:07.443373 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f071dcae-0b6f-4f0f-8388-b566902d5a37 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1505 microversion: 2.1 time: 0.262564 Aug 10 11:20:07.449768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 320/629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:07 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:20:07.592417 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-08644138-f4e3-4388-bc96-68c1f6f58951 req-160422fa-699e-4ab3-a0f2-df0641c10ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2b59a8-db1b-472e-8320-3231f8bd5fb2", "name": "network-vif-deleted", "tag": "1ad577b8-a5bc-4866-aa6d-7f89377545ca"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:07.601914 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-08644138-f4e3-4388-bc96-68c1f6f58951 req-160422fa-699e-4ab3-a0f2-df0641c10ef7 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:07.602384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-08644138-f4e3-4388-bc96-68c1f6f58951 req-160422fa-699e-4ab3-a0f2-df0641c10ef7 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:07.602837 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-08644138-f4e3-4388-bc96-68c1f6f58951 req-160422fa-699e-4ab3-a0f2-df0641c10ef7 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:07.614004 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-08644138-f4e3-4388-bc96-68c1f6f58951 req-160422fa-699e-4ab3-a0f2-df0641c10ef7 service nova] Creating event network-vif-deleted:1ad577b8-a5bc-4866-aa6d-7f89377545ca for instance 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 on hv-cinder-85272 Aug 10 11:20:07.618835 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-08644138-f4e3-4388-bc96-68c1f6f58951 req-160422fa-699e-4ab3-a0f2-df0641c10ef7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030125 Aug 10 11:20:07.619415 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 310/630] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:20:08.327512 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:08.328086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:08.335058 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:08.335702 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:08.336138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:08.336831 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:08.337283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:08.337701 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:08.464809 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:08.465303 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:08.466177 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:08.472769 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:08.473256 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:08.473495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:08.473687 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:08.474552 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:08.475049 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:08.475209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:08.475592 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:08.476204 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5d81e736-82b5-45b8-b76a-79c23977950d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.152777 Aug 10 11:20:08.476763 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 321/631] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:08 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:08.542468 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:08.550869 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e534f8e0-2602-491e-8efc-e7e315e56288 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 200 len: 1463 microversion: 2.1 time: 0.090734 Aug 10 11:20:08.551588 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 311/632] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:08 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 1463 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:20:09.501264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:09.501875 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:09.508507 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:09.508992 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:09.509433 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:09.510156 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:09.510629 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:09.511054 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:09.531666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:09.571455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:09.572041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 4e2b59a8-db1b-472e-8320-3231f8bd5fb2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:09.578353 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:09.578868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:09.579302 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:09.580020 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:09.581007 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:09.581428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:09.594561 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] HTTP exception thrown: Instance 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 could not be found. Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Request method failure captured: Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 HTTP/1.1 Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85K2E2Wrim3-FxJMDYkkzQ_TMt5XzYbkWrEXOnPp9f0n4bCiKVg5CauNkfwdqiV0X33kGX_Mxw_UEozhsObEyrl7sEgn5MXwNG1VgK0TxGl-tvYd7MgLVE2Sx7DPXAFidcuR5kUzdLm67tAihNIGsOEgKSQHtJi9BHRYLOrW4INPUEk Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:20:09.596917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 5d1368fb915444b599b3fcf3f5586789 Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 could not be found. Aug 10 11:20:09.598476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '4e2b59a8-db1b-472e-8320-3231f8bd5fb2'} Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 could not be found. Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:20:09.599537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 could not be found. Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 could not be found. Aug 10 11:20:09.600990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:20:09.602378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Returning 404 to user: Instance 4e2b59a8-db1b-472e-8320-3231f8bd5fb2 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:20:09.602378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0e4ebb21-5b9e-43db-8d40-e471275d82e7 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2" status: 404 len: 111 microversion: 2.1 time: 0.030657 Aug 10 11:20:09.602378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 312/633] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:09 2022] GET /compute/v2.1/servers/4e2b59a8-db1b-472e-8320-3231f8bd5fb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:20:09.606882 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:09.607376 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:09.613555 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:09.614116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:09.614657 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:09.615455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:09.616008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:09.616410 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:09.641883 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:20:09.717172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-df285d46-9eab-4859-b552-fa2bfbd10cc0 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 204 len: 0 microversion: 2.1 time: 0.113569 Aug 10 11:20:09.717778 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 313/634] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:20:09 2022] DELETE /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:20:09.726837 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:09.727638 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:09.733444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:09.734594 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:09.735101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:09.735871 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:09.736934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:09.737407 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:09.741547 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:09.761247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:09.770519 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:09.772232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:09.773570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-732a6f6d-837e-4956-808d-8ab1065be9c2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1722 microversion: 2.20 time: 0.276251 Aug 10 11:20:09.774199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 322/635] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:09 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:20:09.951402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:09.958798 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c703585d-52ef-4c44-9f98-bc9d6179a853 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.236084 Aug 10 11:20:09.959427 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 314/636] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:09 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:10.322336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-21e1ce82-5dee-4192-958c-64581b192763 req-1c1c76e4-3705-488d-bdc3-bd10d331c061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee85970-24fd-4e03-9c90-460c66ab82e9", "name": "network-vif-deleted", "tag": "7396eb48-6699-42c7-8c7f-8122d6c9707a"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:10.333214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-21e1ce82-5dee-4192-958c-64581b192763 req-1c1c76e4-3705-488d-bdc3-bd10d331c061 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:10.333689 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-21e1ce82-5dee-4192-958c-64581b192763 req-1c1c76e4-3705-488d-bdc3-bd10d331c061 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:10.334318 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-21e1ce82-5dee-4192-958c-64581b192763 req-1c1c76e4-3705-488d-bdc3-bd10d331c061 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:10.345631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-21e1ce82-5dee-4192-958c-64581b192763 req-1c1c76e4-3705-488d-bdc3-bd10d331c061 service nova] Creating event network-vif-deleted:7396eb48-6699-42c7-8c7f-8122d6c9707a for instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 on hv-cinder-85272 Aug 10 11:20:10.351068 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-21e1ce82-5dee-4192-958c-64581b192763 req-1c1c76e4-3705-488d-bdc3-bd10d331c061 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032369 Aug 10 11:20:10.351658 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 323/637] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:10.796940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:10.797576 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:10.804533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:10.805017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:10.805446 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:10.806132 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:10.806596 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:10.807021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:10.871865 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:10.879800 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:10.881322 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:10.882495 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5c598cbf-10bf-42bb-b408-a45065f4b395 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1655 microversion: 2.20 time: 0.089514 Aug 10 11:20:10.883068 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 315/638] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:10 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:10.980354 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:10.981112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:10.987226 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:10.987715 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:10.988161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:10.988859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:10.989315 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:10.989751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:11.121904 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:11.129827 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-71943f95-8197-4853-b841-0ae373f8a3f4 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.154143 Aug 10 11:20:11.130787 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 324/639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:10 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:11.906069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:11.906747 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:11.913779 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:11.914342 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:11.915149 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:11.915921 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:11.916441 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:11.916970 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:11.949530 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:11.950008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:11.950437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:11.950909 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lazy-loading 'fault' on Instance uuid 2ee85970-24fd-4e03-9c90-460c66ab82e9 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:20:11.991595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:11.999452 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:12.000943 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:12.002582 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2b0db43f-e6cd-4eb4-a848-2549f9a83302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 200 len: 1371 microversion: 2.20 time: 0.100764 Aug 10 11:20:12.003154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 316/640] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:11 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:12.151030 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:12.151567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:12.157924 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:12.158931 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:12.159376 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:12.160069 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:12.160523 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:12.160947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:12.291384 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:12.298852 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3a72ad64-34b6-4e93-85a2-fb2c80f3be03 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1520 microversion: 2.1 time: 0.151714 Aug 10 11:20:12.300008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 325/641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:12 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:12.972436 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-774b4945-3c6c-4a1b-8a0f-e9e3f57557e3 req-35be4866-62ae-4b10-99f7-28bd46b72916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265d9c1c-b86e-449c-a651-b8bc81225a88", "name": "network-vif-deleted", "tag": "bb7aa967-f1f0-4b38-a15e-3915333bb12b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:12.983531 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-774b4945-3c6c-4a1b-8a0f-e9e3f57557e3 req-35be4866-62ae-4b10-99f7-28bd46b72916 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:12.984002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-774b4945-3c6c-4a1b-8a0f-e9e3f57557e3 req-35be4866-62ae-4b10-99f7-28bd46b72916 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:12.984431 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-774b4945-3c6c-4a1b-8a0f-e9e3f57557e3 req-35be4866-62ae-4b10-99f7-28bd46b72916 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:13.004494 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-774b4945-3c6c-4a1b-8a0f-e9e3f57557e3 req-35be4866-62ae-4b10-99f7-28bd46b72916 service nova] Creating event network-vif-deleted:bb7aa967-f1f0-4b38-a15e-3915333bb12b for instance 265d9c1c-b86e-449c-a651-b8bc81225a88 on hv-cinder-85272 Aug 10 11:20:13.009572 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-774b4945-3c6c-4a1b-8a0f-e9e3f57557e3 req-35be4866-62ae-4b10-99f7-28bd46b72916 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040927 Aug 10 11:20:13.010264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 317/642] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:13.025148 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:13.025756 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:13.032263 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:13.033368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:13.033368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:13.033991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:13.034488 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:13.034944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:13.049442 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] HTTP exception thrown: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Request method failure captured: Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 HTTP/1.1 Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85MqnzrnppNEigvBcgpmydIaGJhjEIiJzNzuv9iwQlQZp9rp1W_ZWhTpOtazDSI0excz8v_ew1s-wRuIQjGf40kt90yfUNs2V4rinYZhFzy2s5_ixT_EQRBSpN_PcuDaJu7ZBKyyhlCDXbjQMXgSZpsy6lieW7Rig358dylsb9EXLmM Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:20:13.051190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 1f000354b524462bb66812138c6e4695 Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:20:13.053034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '2ee85970-24fd-4e03-9c90-460c66ab82e9'} Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:20:13.053810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:20:13.055050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:13.056113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Returning 404 to user: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:20:13.056113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8a82f604-96ee-4912-b1a3-6cf828a4a844 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 404 len: 111 microversion: 2.20 time: 0.031541 Aug 10 11:20:13.056113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 326/643] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:13 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:20:13.063971 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-715f0cf6-198b-40f0-a31f-0884e9da29d5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '.version_select at 0x7fccf81edb80>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:13.090995 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-715f0cf6-198b-40f0-a31f-0884e9da29d5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931215633" status: 204 len: 0 microversion: 2.20 time: 0.031091 Aug 10 11:20:13.091719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 318/644] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 10 11:20:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931215633 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 11:20:13.320149 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:13.320761 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:13.327354 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:13.327846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:13.328299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:13.328999 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:13.329460 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:13.329888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:13.363626 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:13.364538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:13.364639 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:13.365005 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lazy-loading 'fault' on Instance uuid 265d9c1c-b86e-449c-a651-b8bc81225a88 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:20:13.444590 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d1368fb915444b599b3fcf3f5586789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429a80ecb8464ef3ad67a23a06fc10f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:13.453366 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-53dc943d-3935-48ab-bf7b-213b87a8623c tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 200 len: 1311 microversion: 2.1 time: 0.137267 Aug 10 11:20:13.454003 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 327/645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:13 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:13.756054 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5d58ff0c-b5c8-4677-911d-6dc4ebb5f697 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'create', calling method: .version_select at 0x7fccf2fadc10>, body: {"keypair": {"name": "tempest-keypair-2080956722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjnwvGtZpFGAVLORvfvx/4h7ZKzGr7+Ld0MmmSL2mqrjmg/dTfynSq9fvZUvReXCxj0TCBjQrCZXq26J0o0cP6cy8jqNK/9jF6zisJBFMM0n44kIrsrjKYUofqU65uZGg=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:13.771518 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-5d58ff0c-b5c8-4677-911d-6dc4ebb5f697 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Getting quotas for project 0a19aabba33c4e0ab7b3f2d9d58ec621. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:20:13.775301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-5d58ff0c-b5c8-4677-911d-6dc4ebb5f697 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Getting quotas for user 1f000354b524462bb66812138c6e4695 and project 0a19aabba33c4e0ab7b3f2d9d58ec621. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:20:13.796603 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5d58ff0c-b5c8-4677-911d-6dc4ebb5f697 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044554 Aug 10 11:20:13.797190 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 319/646] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 10 11:20:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 11:20:14.475011 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:14.475657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] [instance: 265d9c1c-b86e-449c-a651-b8bc81225a88] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:14.481976 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:14.482470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:14.482974 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:14.483644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:14.484097 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:14.484525 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:14.498469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] HTTP exception thrown: Instance 265d9c1c-b86e-449c-a651-b8bc81225a88 could not be found. Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Request method failure captured: Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 HTTP/1.1 Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85K2E2Wrim3-FxJMDYkkzQ_TMt5XzYbkWrEXOnPp9f0n4bCiKVg5CauNkfwdqiV0X33kGX_Mxw_UEozhsObEyrl7sEgn5MXwNG1VgK0TxGl-tvYd7MgLVE2Sx7DPXAFidcuR5kUzdLm67tAihNIGsOEgKSQHtJi9BHRYLOrW4INPUEk Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:20:14.500018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_429a80ecb8464ef3ad67a23a06fc10f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 429a80ecb8464ef3ad67a23a06fc10f7 Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-995061874 Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 5d1368fb915444b599b3fcf3f5586789 Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-995061874-project Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 265d9c1c-b86e-449c-a651-b8bc81225a88 could not be found. Aug 10 11:20:14.501544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '265d9c1c-b86e-449c-a651-b8bc81225a88'} Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265d9c1c-b86e-449c-a651-b8bc81225a88 could not be found. Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:20:14.502696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265d9c1c-b86e-449c-a651-b8bc81225a88 could not be found. Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265d9c1c-b86e-449c-a651-b8bc81225a88 could not be found. Aug 10 11:20:14.504131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:14.505494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] Returning 404 to user: Instance 265d9c1c-b86e-449c-a651-b8bc81225a88 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:20:14.505494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-77e70504-79ab-4142-b352-0b833cf20ea8 tempest-ServerRescueNegativeTestJSON-995061874 tempest-ServerRescueNegativeTestJSON-995061874-project] 10.222.0.49 "GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88" status: 404 len: 111 microversion: 2.1 time: 0.030816 Aug 10 11:20:14.505494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 328/647] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:14 2022] GET /compute/v2.1/servers/265d9c1c-b86e-449c-a651-b8bc81225a88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:20:15.016521 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1527853271", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "123e1a3f-132b-4e54-8cad-553dfa7b8f8b"}], "security_groups": [{"name": "tempest-securitygroup--1172019007"}], "key_name": "tempest-keypair-2080956722", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:15.390301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] validate_networks() for [('123e1a3f-132b-4e54-8cad-553dfa7b8f8b', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:20:16.020663 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:20:16.021252 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:20:16.021728 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:20:16.022210 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:20:16.022719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:20:16.031631 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:16.032116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:16.032551 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:16.033279 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:16.033736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:16.034162 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:16.050646 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Getting quotas for project 0a19aabba33c4e0ab7b3f2d9d58ec621. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:20:16.054597 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Getting quotas for user 1f000354b524462bb66812138c6e4695 and project 0a19aabba33c4e0ab7b3f2d9d58ec621. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:20:16.066437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:20:16.068841 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:20:16.117103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-31770c4a-2880-4e23-a1ed-fc3e90076300 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.105435 Aug 10 11:20:16.117845 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 320/648] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 10 11:20:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 11:20:16.132462 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-35837f5a-578f-4a4f-8262-e5f592c6bca8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:16.133086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-35837f5a-578f-4a4f-8262-e5f592c6bca8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:16.207951 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-35837f5a-578f-4a4f-8262-e5f592c6bca8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:16.216974 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-35837f5a-578f-4a4f-8262-e5f592c6bca8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:16.219419 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-35837f5a-578f-4a4f-8262-e5f592c6bca8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:16.221131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-35837f5a-578f-4a4f-8262-e5f592c6bca8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1282 microversion: 2.20 time: 0.095945 Aug 10 11:20:16.230097 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 329/649] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:16 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:16.928482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa2a0579-9849-44c7-b3ef-3d242ff859e3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:16.931183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa2a0579-9849-44c7-b3ef-3d242ff859e3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:16.938549 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa2a0579-9849-44c7-b3ef-3d242ff859e3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:16.939337 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa2a0579-9849-44c7-b3ef-3d242ff859e3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:16.940718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa2a0579-9849-44c7-b3ef-3d242ff859e3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:16.941745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa2a0579-9849-44c7-b3ef-3d242ff859e3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:16.942270 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa2a0579-9849-44c7-b3ef-3d242ff859e3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:16.942833 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa2a0579-9849-44c7-b3ef-3d242ff859e3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:16.975535 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa2a0579-9849-44c7-b3ef-3d242ff859e3 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052663 Aug 10 11:20:16.981684 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 321/650] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:20:16 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:20:17.041408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:17.041993 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:17.048266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:17.048850 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:17.050055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:17.050877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:17.051402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:17.051899 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:17.081532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:20:17.163348 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a63a67b4-ac3b-46ae-b68d-de89308547b7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 204 len: 0 microversion: 2.1 time: 0.125474 Aug 10 11:20:17.164638 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 330/651] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:20:17 2022] DELETE /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:20:17.174196 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:17.181418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:17.193170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:17.193993 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:17.194679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:17.195653 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:17.196262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:17.196977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:17.254367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:17.255444 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:17.262452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:17.263211 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:17.263851 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:17.264556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:17.265188 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:17.265608 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:17.352400 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:17.362146 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:17.363879 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:17.365208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-090836dc-0a81-4176-ae9b-4d30e98cf4c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1342 microversion: 2.20 time: 0.119301 Aug 10 11:20:17.365931 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 331/652] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:17 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1342 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:17.384928 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:17.392882 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-63e4596c-3d14-478e-bdd0-476b86c77b53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1674 microversion: 2.1 time: 0.222316 Aug 10 11:20:17.393391 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 322/653] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:17 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:18.390631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:18.391151 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:18.404585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:18.405076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:18.405514 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:18.406212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:18.406691 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:18.407337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:18.416862 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:18.417284 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:18.426017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:18.426518 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:18.427068 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:18.427783 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:18.428244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:18.429235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:18.543220 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:18.557487 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:18.560540 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:18.562550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-11cc2af9-f857-47a4-9b3a-55e79f125073 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1340 microversion: 2.20 time: 0.178976 Aug 10 11:20:18.564195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 332/654] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:18 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1340 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:20:18.720434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:18.729411 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-397b7725-b626-4816-85fe-5ef948b23fe8 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1674 microversion: 2.1 time: 0.318417 Aug 10 11:20:18.730768 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 323/655] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:18 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1674 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:20:19.586173 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:19.587936 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:19.601604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:19.604664 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:19.605570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:19.606563 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:19.607257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:19.607964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:19.670855 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e667ef09-e3bd-4355-a741-c781eaeb6861 req-36f7528f-ca27-4f83-9925-3cf16c2e61dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d74ab5-9978-4af6-9fff-34b86d739057", "name": "network-vif-deleted", "tag": "90757e23-502d-4a8b-bc8b-3a17f062540c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:19.682815 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e667ef09-e3bd-4355-a741-c781eaeb6861 req-36f7528f-ca27-4f83-9925-3cf16c2e61dc service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:19.683678 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e667ef09-e3bd-4355-a741-c781eaeb6861 req-36f7528f-ca27-4f83-9925-3cf16c2e61dc service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:19.684316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e667ef09-e3bd-4355-a741-c781eaeb6861 req-36f7528f-ca27-4f83-9925-3cf16c2e61dc service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:19.698761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e667ef09-e3bd-4355-a741-c781eaeb6861 req-36f7528f-ca27-4f83-9925-3cf16c2e61dc service nova] Creating event network-vif-deleted:90757e23-502d-4a8b-bc8b-3a17f062540c for instance b5d74ab5-9978-4af6-9fff-34b86d739057 on hv-cinder-85272 Aug 10 11:20:19.703983 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e667ef09-e3bd-4355-a741-c781eaeb6861 req-36f7528f-ca27-4f83-9925-3cf16c2e61dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037005 Aug 10 11:20:19.709705 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 324/656] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:19.765685 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:19.767691 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:19.788849 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:19.790918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:19.794171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:19.795505 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:19.796085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:19.796618 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:19.879350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:19.888431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:19.890831 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:19.892313 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1a14c9c6-a30e-4677-acd3-3035a232ae46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1408 microversion: 2.20 time: 0.310826 Aug 10 11:20:19.898479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 333/657] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:19 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:19.920864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:19.946154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-97eb3c9c-555f-427c-a023-77355c62be5c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 200 len: 1323 microversion: 2.1 time: 0.193523 Aug 10 11:20:19.948110 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 325/658] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:19 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:19.969288 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-e3d04e2d-2a05-42c3-90e8-b99feae82496 req-06dec59a-5d2a-49c1-b7e1-817e813f94af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00252e7d-b9e4-4476-a984-b33aa7286520", "tag": "70b8271c-1d70-4963-bf31-d732658386fc"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:19.996379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e3d04e2d-2a05-42c3-90e8-b99feae82496 req-06dec59a-5d2a-49c1-b7e1-817e813f94af service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:19.996858 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e3d04e2d-2a05-42c3-90e8-b99feae82496 req-06dec59a-5d2a-49c1-b7e1-817e813f94af service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:19.997290 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e3d04e2d-2a05-42c3-90e8-b99feae82496 req-06dec59a-5d2a-49c1-b7e1-817e813f94af service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:20.012798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-e3d04e2d-2a05-42c3-90e8-b99feae82496 req-06dec59a-5d2a-49c1-b7e1-817e813f94af service nova] Creating event network-changed:70b8271c-1d70-4963-bf31-d732658386fc for instance 00252e7d-b9e4-4476-a984-b33aa7286520 on hv-cinder-85272 Aug 10 11:20:20.022134 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-e3d04e2d-2a05-42c3-90e8-b99feae82496 req-06dec59a-5d2a-49c1-b7e1-817e813f94af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060218 Aug 10 11:20:20.024254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 334/659] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:20:20.920626 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:20.921399 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:20.929739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:20.930529 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:20.931198 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:20.932116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:20.933189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:20.934242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:20.973448 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:20.974381 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:20.983597 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:20.984725 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:20.985777 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:20.987249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:20.988253 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:20.989009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:21.007444 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] HTTP exception thrown: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Request method failure captured: Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 HTTP/1.1 Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LJXyGVgk4g3BF3bMkM3zeA9lRX1mdmNSG2EOwCyfF4jJKpilCkulhY1NqNLBb2RW08AiPt5Ot7UKRjiWxZhysCkEA1SDBGd1OnmiMRGTkZP5tvpNh1RA9f8pwYJGcwC4IoFjWqGPxxU3St_kUKrCtq3-v7kzUl0DxdNCNnLWFIxPY Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:20:21.009646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c66f397e080f497da06b661ea1a87e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 951cabf887f14896b0c4402b686be697 Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:20:21.011063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': 'b5d74ab5-9978-4af6-9fff-34b86d739057'} Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:20:21.012045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:20:21.013224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:20:21.014283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Returning 404 to user: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:20:21.014283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1e54e400-c0dd-4841-88e7-85d31f54c891 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 404 len: 111 microversion: 2.1 time: 0.044517 Aug 10 11:20:21.014283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 335/660] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:20 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:20:21.021009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9a4c687b-3a1a-4b9e-a56a-2b017f75b405 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '.version_select at 0x7fccf815d670>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:21.049063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9a4c687b-3a1a-4b9e-a56a-2b017f75b405 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523387340" status: 202 len: 0 microversion: 2.1 time: 0.031545 Aug 10 11:20:21.050064 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 336/661] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 10 11:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523387340 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:20:21.463702 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:21.473308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:21.474865 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:21.476201 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65db39a4-bcac-4e52-b6e9-2f579d68a45d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1408 microversion: 2.20 time: 0.559617 Aug 10 11:20:21.486638 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 326/662] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:20 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1408 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:21.916947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2fcc8e96-ba69-497e-8bae-9dfbcee13e53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'create', calling method: .version_select at 0x7fccf36c99d0>, body: {"keypair": {"name": "tempest-keypair-1389543953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxfwooa0GDzy4eK7EpWPaPBSo9+BaEtClwHJCJxLQYBPLB4jWZkFfbbQSOLniQa95qTk4OIqVZRN7QQshmlC8cLslt3ipb/tNqJQArj3BeoCSXjoDnarVaiBFyQMPxXtQ=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:21.933369 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-2fcc8e96-ba69-497e-8bae-9dfbcee13e53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Getting quotas for project c66f397e080f497da06b661ea1a87e03. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:20:21.937147 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-2fcc8e96-ba69-497e-8bae-9dfbcee13e53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Getting quotas for user 951cabf887f14896b0c4402b686be697 and project c66f397e080f497da06b661ea1a87e03. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:20:21.958470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2fcc8e96-ba69-497e-8bae-9dfbcee13e53 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045601 Aug 10 11:20:21.959399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 337/663] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:20:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:22.498885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:22.500138 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:22.505491 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:22.517638 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:22.518761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:22.519743 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:22.521047 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:22.522021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:22.524507 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:22.708550 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:22.718016 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:22.719581 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:22.721638 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-10b04970-3a61-4e26-9dd9-d9f6211f6666 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1408 microversion: 2.20 time: 0.226277 Aug 10 11:20:22.722453 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 327/664] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:22 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:23.430476 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1518603542", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "314bd9c0-3648-481f-8543-275a17b2db6e"}], "security_groups": [{"name": "tempest-securitygroup--728432169"}], "key_name": "tempest-keypair-1389543953", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:23.537595 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] validate_networks() for [('314bd9c0-3648-481f-8543-275a17b2db6e', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:20:23.744008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:23.745579 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:23.753277 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:23.753725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:23.754159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:23.754888 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:23.755690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:23.756123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:23.942535 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:23.950754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:23.952487 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:23.953610 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b858c4b-4f37-4e2a-960a-e5718b78a57e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1408 microversion: 2.20 time: 0.214386 Aug 10 11:20:23.954410 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 328/665] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:23 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:24.067648 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:20:24.068072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:20:24.068542 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:20:24.068948 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:20:24.069357 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:20:24.072418 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:24.080053 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:24.080631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:24.081069 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:24.081782 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:24.082235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:24.082682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:24.101512 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Getting quotas for project c66f397e080f497da06b661ea1a87e03. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:20:24.105752 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Getting quotas for user 951cabf887f14896b0c4402b686be697 and project c66f397e080f497da06b661ea1a87e03. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:20:24.117865 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:20:24.120438 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:20:24.166260 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-520bfc6c-b690-4800-b6a9-52b6ef226176 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.740005 Aug 10 11:20:24.167196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 338/666] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:20:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:20:24.178259 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d877d03b-eb7c-499c-a4c7-280bfe30f204 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:24.179061 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d877d03b-eb7c-499c-a4c7-280bfe30f204 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:24.232464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d877d03b-eb7c-499c-a4c7-280bfe30f204 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:24.240406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d877d03b-eb7c-499c-a4c7-280bfe30f204 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1238 microversion: 2.1 time: 0.065933 Aug 10 11:20:24.240978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 329/667] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:24 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:24.976822 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:24.977539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:24.985570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:24.986139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:24.987277 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:24.988047 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:24.988563 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:24.989051 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:25.188521 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:25.200122 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:25.201847 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:25.203513 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a19e31bd-e6f3-44b2-891e-54899e048471 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1408 microversion: 2.20 time: 0.230691 Aug 10 11:20:25.204184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 339/668] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:24 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:25.261373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:25.263086 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:25.271364 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:25.272205 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:25.273062 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:25.274044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:25.274757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:25.275394 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:25.367923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:25.385570 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ec23d633-61c2-46a1-a241-1ca2b6fd9eb6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1298 microversion: 2.1 time: 0.128016 Aug 10 11:20:25.386373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 330/669] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:25 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:26.239769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:26.240399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:26.254662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:26.255002 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:26.255442 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:26.256422 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:26.263151 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:26.264046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:26.406785 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:26.408031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:26.411022 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:26.417778 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:26.418441 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:26.419048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:26.419934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:26.420542 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:26.421274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:26.629995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:26.638742 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:26.640254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:26.641544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b3c2b525-9eb5-4bac-97d4-de2921950ee5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1408 microversion: 2.20 time: 0.418730 Aug 10 11:20:26.654847 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 340/670] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:26 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1408 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:20:26.662381 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-dc193b24-389c-4c4f-a23b-a52fa2a8bfe6 req-dc6c5718-4c6d-40bd-be65-a7104eac6ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00252e7d-b9e4-4476-a984-b33aa7286520", "name": "network-vif-plugged", "status": "completed", "tag": "70b8271c-1d70-4963-bf31-d732658386fc"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:26.673557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-dc193b24-389c-4c4f-a23b-a52fa2a8bfe6 req-dc6c5718-4c6d-40bd-be65-a7104eac6ab9 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:26.674643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-dc193b24-389c-4c4f-a23b-a52fa2a8bfe6 req-dc6c5718-4c6d-40bd-be65-a7104eac6ab9 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:26.675561 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-dc193b24-389c-4c4f-a23b-a52fa2a8bfe6 req-dc6c5718-4c6d-40bd-be65-a7104eac6ab9 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:26.687726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-dc193b24-389c-4c4f-a23b-a52fa2a8bfe6 req-dc6c5718-4c6d-40bd-be65-a7104eac6ab9 service nova] Creating event network-vif-plugged:70b8271c-1d70-4963-bf31-d732658386fc for instance 00252e7d-b9e4-4476-a984-b33aa7286520 on hv-cinder-85272 Aug 10 11:20:26.693175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-dc193b24-389c-4c4f-a23b-a52fa2a8bfe6 req-dc6c5718-4c6d-40bd-be65-a7104eac6ab9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036940 Aug 10 11:20:26.693785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 341/671] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:26.720754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:26.729177 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c82cdc0c-947e-4d7a-96ee-bddfbda83f89 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1363 microversion: 2.1 time: 0.326173 Aug 10 11:20:26.729847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 331/672] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:26 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:20:27.018149 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-73bfea38-7c07-41ec-81e3-a5643fe1bd76 req-cb007905-5117-4cfc-b86d-8a0afad42478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "867eae69-3eb0-4d39-8851-02501b561bfe", "tag": "c31171e3-d858-4518-a0f7-1da5d2d0ff09"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:27.027658 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-73bfea38-7c07-41ec-81e3-a5643fe1bd76 req-cb007905-5117-4cfc-b86d-8a0afad42478 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:27.028347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-73bfea38-7c07-41ec-81e3-a5643fe1bd76 req-cb007905-5117-4cfc-b86d-8a0afad42478 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:27.028965 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-73bfea38-7c07-41ec-81e3-a5643fe1bd76 req-cb007905-5117-4cfc-b86d-8a0afad42478 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:27.041218 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-73bfea38-7c07-41ec-81e3-a5643fe1bd76 req-cb007905-5117-4cfc-b86d-8a0afad42478 service nova] Creating event network-changed:c31171e3-d858-4518-a0f7-1da5d2d0ff09 for instance 867eae69-3eb0-4d39-8851-02501b561bfe on hv-cinder-85272 Aug 10 11:20:27.046107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-73bfea38-7c07-41ec-81e3-a5643fe1bd76 req-cb007905-5117-4cfc-b86d-8a0afad42478 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032284 Aug 10 11:20:27.047340 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 342/673] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:27.668787 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:27.669973 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:27.676275 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:27.676761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:27.677367 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:27.678061 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:27.678511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:27.678955 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:27.757023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:27.757698 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:27.764706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:27.765234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:27.765616 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:27.766311 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:27.766800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:27.767226 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:27.840847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:27.849501 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:27.851319 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:27.852894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3fd72a40-63d1-441d-b329-b53a4d2fb831 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1408 microversion: 2.20 time: 0.187780 Aug 10 11:20:27.854348 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 332/674] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:27 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:27.906141 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:27.913481 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fb8465e1-2de0-466e-b275-a5ce4598002b tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1363 microversion: 2.1 time: 0.161405 Aug 10 11:20:27.914039 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 343/675] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:27 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:20:28.875536 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:28.876526 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:28.884022 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:28.884654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:28.885107 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:28.885818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:28.886275 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:28.886927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:28.934964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:28.935615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:28.942556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:28.943083 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:28.943525 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:28.944227 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:28.945176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:28.945639 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:29.218976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:29.227291 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:29.229071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:29.230234 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2acc7fcc-7121-48fa-9a84-dbfa48d67792 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1601 microversion: 2.20 time: 0.359118 Aug 10 11:20:29.231470 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 333/676] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:20:28 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1601 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:29.232633 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:29.240736 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5171d970-609a-44d2-ad41-79cbe35e8618 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1363 microversion: 2.1 time: 0.310114 Aug 10 11:20:29.241673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 344/677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:28 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:20:29.254274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7625aa51-f6d8-4054-8815-f05f8f81d469 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:29.255086 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7625aa51-f6d8-4054-8815-f05f8f81d469 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:29.261280 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7625aa51-f6d8-4054-8815-f05f8f81d469 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:29.261770 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7625aa51-f6d8-4054-8815-f05f8f81d469 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:29.262216 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7625aa51-f6d8-4054-8815-f05f8f81d469 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:29.262988 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7625aa51-f6d8-4054-8815-f05f8f81d469 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:29.263433 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7625aa51-f6d8-4054-8815-f05f8f81d469 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:29.263855 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7625aa51-f6d8-4054-8815-f05f8f81d469 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:29.346075 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7625aa51-f6d8-4054-8815-f05f8f81d469 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096295 Aug 10 11:20:29.346852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 334/678] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 10 11:20:29 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:20:30.262121 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:30.262701 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:30.271040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:30.274846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:30.275549 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:30.276473 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:30.277136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:30.277880 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:30.300102 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:30.482923 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:30.492921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a14fa66f-96d9-49c2-966f-af9faace886d tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1363 microversion: 2.1 time: 0.234633 Aug 10 11:20:30.493955 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 345/679] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:30 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:30.653158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a21f5303-4689-431b-8584-7861662adc09 req-869f7f1a-5fd6-44fa-a9fa-a0450b0fb7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00252e7d-b9e4-4476-a984-b33aa7286520", "tag": "70b8271c-1d70-4963-bf31-d732658386fc"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:30.664734 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a21f5303-4689-431b-8584-7861662adc09 req-869f7f1a-5fd6-44fa-a9fa-a0450b0fb7e1 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:30.665499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a21f5303-4689-431b-8584-7861662adc09 req-869f7f1a-5fd6-44fa-a9fa-a0450b0fb7e1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:30.666229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a21f5303-4689-431b-8584-7861662adc09 req-869f7f1a-5fd6-44fa-a9fa-a0450b0fb7e1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:30.685160 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a21f5303-4689-431b-8584-7861662adc09 req-869f7f1a-5fd6-44fa-a9fa-a0450b0fb7e1 service nova] Creating event network-changed:70b8271c-1d70-4963-bf31-d732658386fc for instance 00252e7d-b9e4-4476-a984-b33aa7286520 on hv-cinder-85272 Aug 10 11:20:30.693990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a21f5303-4689-431b-8584-7861662adc09 req-869f7f1a-5fd6-44fa-a9fa-a0450b0fb7e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046030 Aug 10 11:20:30.697175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 335/680] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:31.513571 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:31.514817 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:31.521511 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:31.522250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:31.522873 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:31.523725 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:31.524333 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:31.525173 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:31.768813 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:31.776913 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-919933a7-717b-4480-a9de-eb6772d15396 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1363 microversion: 2.1 time: 0.267122 Aug 10 11:20:31.777697 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 346/681] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:31 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:32.800037 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:32.800736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:32.807101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:32.807587 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:32.808026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:32.808719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:32.809175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:32.809603 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:32.828031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:32.939020 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:32.947335 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-428f33d6-61dd-4e2a-925a-2a4a96644ff9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1363 microversion: 2.1 time: 0.151987 Aug 10 11:20:32.947907 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 336/682] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:32 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:33.967956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:33.968555 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:33.975654 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:33.976130 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:33.976564 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:33.977246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:33.977722 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:33.978143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:34.091073 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:34.106025 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:34.113747 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7e2245ba-fd41-4599-981a-6f48d8741559 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1363 microversion: 2.1 time: 0.149676 Aug 10 11:20:34.114303 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 347/683] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:33 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:34.389026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-39278d03-cab1-4ce7-994f-3cc3752b4b32 req-a6fadeb0-7240-4050-8f29-afbd1101dad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "867eae69-3eb0-4d39-8851-02501b561bfe", "name": "network-vif-plugged", "status": "completed", "tag": "c31171e3-d858-4518-a0f7-1da5d2d0ff09"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:34.395613 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=12 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:34.401521 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-39278d03-cab1-4ce7-994f-3cc3752b4b32 req-a6fadeb0-7240-4050-8f29-afbd1101dad1 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:34.401993 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-39278d03-cab1-4ce7-994f-3cc3752b4b32 req-a6fadeb0-7240-4050-8f29-afbd1101dad1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:34.402425 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-39278d03-cab1-4ce7-994f-3cc3752b4b32 req-a6fadeb0-7240-4050-8f29-afbd1101dad1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:34.413900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-39278d03-cab1-4ce7-994f-3cc3752b4b32 req-a6fadeb0-7240-4050-8f29-afbd1101dad1 service nova] Creating event network-vif-plugged:c31171e3-d858-4518-a0f7-1da5d2d0ff09 for instance 867eae69-3eb0-4d39-8851-02501b561bfe on hv-cinder-85272 Aug 10 11:20:34.418674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-39278d03-cab1-4ce7-994f-3cc3752b4b32 req-a6fadeb0-7240-4050-8f29-afbd1101dad1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033296 Aug 10 11:20:34.419559 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 337/684] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:20:35.133709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:35.134237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:35.136086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=12 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:35.141639 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:35.142124 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:35.142559 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:35.143758 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:35.144209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:35.144631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:35.270558 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:35.277858 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a7a3f550-1236-4daf-a898-1e76fbb5fc59 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1363 microversion: 2.1 time: 0.148075 Aug 10 11:20:35.278419 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 348/685] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:35 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:36.298797 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:36.300163 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:36.306153 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:36.306663 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:36.307127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:36.307810 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:36.308268 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:36.308687 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:36.445459 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:36.453013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29ca71ae-5947-4919-be67-f1c639c04eb0 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1363 microversion: 2.1 time: 0.158876 Aug 10 11:20:36.453575 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 338/686] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:36 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:37.477324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:37.478645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:37.488081 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:37.488810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:37.489459 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:37.490515 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:37.491358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:37.500590 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:37.630236 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:20:37.637723 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0824de15-0b0f-465f-8980-f7dd5be7d5f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1549 microversion: 2.1 time: 0.166965 Aug 10 11:20:37.638287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 349/687] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:20:37 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:20:37.658655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fbb18616-f985-4461-bbe6-1e86e2332ebf tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:37.659648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fbb18616-f985-4461-bbe6-1e86e2332ebf tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:37.665861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbb18616-f985-4461-bbe6-1e86e2332ebf tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:37.666351 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbb18616-f985-4461-bbe6-1e86e2332ebf tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:37.666826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbb18616-f985-4461-bbe6-1e86e2332ebf tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:37.667548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbb18616-f985-4461-bbe6-1e86e2332ebf tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:37.668013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbb18616-f985-4461-bbe6-1e86e2332ebf tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:37.668533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbb18616-f985-4461-bbe6-1e86e2332ebf tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:37.744489 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fbb18616-f985-4461-bbe6-1e86e2332ebf tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089626 Aug 10 11:20:37.745353 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 339/688] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 11:20:37 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:38.948977 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-1797791c-8ab5-49e6-a30d-49b96602c7c3 req-0de991ac-9711-447d-8e4d-3f65282799e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "867eae69-3eb0-4d39-8851-02501b561bfe", "tag": "c31171e3-d858-4518-a0f7-1da5d2d0ff09"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:38.959487 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1797791c-8ab5-49e6-a30d-49b96602c7c3 req-0de991ac-9711-447d-8e4d-3f65282799e2 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:38.960005 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1797791c-8ab5-49e6-a30d-49b96602c7c3 req-0de991ac-9711-447d-8e4d-3f65282799e2 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:38.960476 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1797791c-8ab5-49e6-a30d-49b96602c7c3 req-0de991ac-9711-447d-8e4d-3f65282799e2 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:38.972319 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-1797791c-8ab5-49e6-a30d-49b96602c7c3 req-0de991ac-9711-447d-8e4d-3f65282799e2 service nova] Creating event network-changed:c31171e3-d858-4518-a0f7-1da5d2d0ff09 for instance 867eae69-3eb0-4d39-8851-02501b561bfe on hv-cinder-85272 Aug 10 11:20:38.977257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-1797791c-8ab5-49e6-a30d-49b96602c7c3 req-0de991ac-9711-447d-8e4d-3f65282799e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032157 Aug 10 11:20:38.978224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 350/689] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:52.369554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=26 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:52.370312 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=14 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:52.374599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-53ced167-5ed8-46a5-a581-0562f74c66a1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:52.375161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-53ced167-5ed8-46a5-a581-0562f74c66a1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:52.381916 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53ced167-5ed8-46a5-a581-0562f74c66a1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:52.382411 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53ced167-5ed8-46a5-a581-0562f74c66a1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:52.382900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53ced167-5ed8-46a5-a581-0562f74c66a1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:52.383588 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53ced167-5ed8-46a5-a581-0562f74c66a1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:52.384051 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53ced167-5ed8-46a5-a581-0562f74c66a1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:52.384484 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53ced167-5ed8-46a5-a581-0562f74c66a1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:52.407834 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-53ced167-5ed8-46a5-a581-0562f74c66a1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/ips" status: 200 len: 149 microversion: 2.1 time: 0.039715 Aug 10 11:20:52.408603 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 340/690] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:20:52 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:53.840732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:53.841913 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=28 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:53.847471 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cfba2ac1-dac3-4a3a-a059-3c0a6e47583f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03211b60-8c15-4a20-9618-e3c58fbdabf7"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:53.854611 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cfba2ac1-dac3-4a3a-a059-3c0a6e47583f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:20:53.866006 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfba2ac1-dac3-4a3a-a059-3c0a6e47583f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:53.867441 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfba2ac1-dac3-4a3a-a059-3c0a6e47583f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:53.867896 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfba2ac1-dac3-4a3a-a059-3c0a6e47583f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:53.869963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfba2ac1-dac3-4a3a-a059-3c0a6e47583f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:53.870423 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfba2ac1-dac3-4a3a-a059-3c0a6e47583f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:53.870889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfba2ac1-dac3-4a3a-a059-3c0a6e47583f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:54.232161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cfba2ac1-dac3-4a3a-a059-3c0a6e47583f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392698 Aug 10 11:20:54.233857 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 351/691] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:20:53 2022] POST /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:59.772439 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29f856ac-7156-4c3c-ac2d-168cf8c79047 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Action: 'create', calling method: .version_select at 0x7fccf2fadee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2130847063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1pqDtGZNwE1Qif9FSCkV02OwBx/2Hw5iBBWD9DIUqWUkpscaRAkfc52npHVk/5b4ni5TsjCyOootoWYnrMY+SCK0YnFXMNRg3bKk5NGrbc9KoapDhpIOz9alNBUl+x+w=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:20:59.788183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-29f856ac-7156-4c3c-ac2d-168cf8c79047 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Getting quotas for project 5fa6be82e0004c208037e16b0bfc23a2. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:20:59.792237 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-29f856ac-7156-4c3c-ac2d-168cf8c79047 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Getting quotas for user 1734d2f354a247d680f3c6fe7071632c and project 5fa6be82e0004c208037e16b0bfc23a2. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:20:59.816328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29f856ac-7156-4c3c-ac2d-168cf8c79047 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.397617 Aug 10 11:20:59.816927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 341/692] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:20:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:01.968275 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03211b60-8c15-4a20-9618-e3c58fbdabf7"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:01.970863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:01.977953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:01.978430 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:01.978893 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:01.979584 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:01.980033 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:01.980454 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:02.060662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Invalid volume: volume 03211b60-8c15-4a20-9618-e3c58fbdabf7 is already attached to instances: f8547aa0-1882-4f7e-8f8c-971de45eb907 Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments HTTP/1.1 Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 74 Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:21:02.062334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {"volumeAttachment": {"volumeId": "03211b60-8c15-4a20-9618-e3c58fbdabf7"}} Aug 10 11:21:02.064018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Invalid volume: volume 03211b60-8c15-4a20-9618-e3c58fbdabf7 is already attached to instances: f8547aa0-1882-4f7e-8f8c-971de45eb907 Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'server_id': 'f8547aa0-1882-4f7e-8f8c-971de45eb907', 'body': {'volumeAttachment': {'volumeId': '03211b60-8c15-4a20-9618-e3c58fbdabf7'}}} Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03211b60-8c15-4a20-9618-e3c58fbdabf7 is already attached to instances: f8547aa0-1882-4f7e-8f8c-971de45eb907 Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:02.064910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03211b60-8c15-4a20-9618-e3c58fbdabf7 is already attached to instances: f8547aa0-1882-4f7e-8f8c-971de45eb907 Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:21:02.066175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:21:02.067483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:21:02.067483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:21:02.067483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:21:02.067483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03211b60-8c15-4a20-9618-e3c58fbdabf7 is already attached to instances: f8547aa0-1882-4f7e-8f8c-971de45eb907 Aug 10 11:21:02.067483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:02.067483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 400 to user: Invalid volume: volume 03211b60-8c15-4a20-9618-e3c58fbdabf7 is already attached to instances: f8547aa0-1882-4f7e-8f8c-971de45eb907 {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:21:02.067483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a42615e5-edad-47f1-8ed1-6c9530921aa6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099858 Aug 10 11:21:02.067483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 352/693] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:21:01 2022] POST /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:21:02.135312 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:02.135815 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:02.142701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:02.143194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:02.143635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:02.144333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:02.144820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:02.145296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:02.227236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lazy-loading 'services' on Instance uuid f8547aa0-1882-4f7e-8f8c-971de45eb907 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:21:02.302144 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0fbfa3c9-f4cf-4a94-bc24-c55d2c512210 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments/03211b60-8c15-4a20-9618-e3c58fbdabf7" status: 202 len: 0 microversion: 2.1 time: 0.171377 Aug 10 11:21:02.302827 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 342/694] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:21:02 2022] DELETE /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments/03211b60-8c15-4a20-9618-e3c58fbdabf7 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:21:02.311429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a48e5c9a-d205-46d9-a3c9-9a1d982b68b5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:02.313965 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a48e5c9a-d205-46d9-a3c9-9a1d982b68b5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:02.321600 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a48e5c9a-d205-46d9-a3c9-9a1d982b68b5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:02.322082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a48e5c9a-d205-46d9-a3c9-9a1d982b68b5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:02.322809 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a48e5c9a-d205-46d9-a3c9-9a1d982b68b5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:02.331371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a48e5c9a-d205-46d9-a3c9-9a1d982b68b5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:02.331371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a48e5c9a-d205-46d9-a3c9-9a1d982b68b5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:02.331371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a48e5c9a-d205-46d9-a3c9-9a1d982b68b5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:02.367057 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a48e5c9a-d205-46d9-a3c9-9a1d982b68b5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059526 Aug 10 11:21:02.367635 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 353/695] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:21:02 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:03.382984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f50dc5ac-52dd-481e-b541-29f90da04b82 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:03.386405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f50dc5ac-52dd-481e-b541-29f90da04b82 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:03.392749 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f50dc5ac-52dd-481e-b541-29f90da04b82 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:03.393251 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f50dc5ac-52dd-481e-b541-29f90da04b82 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:03.393739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f50dc5ac-52dd-481e-b541-29f90da04b82 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:03.394645 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f50dc5ac-52dd-481e-b541-29f90da04b82 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:03.395463 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f50dc5ac-52dd-481e-b541-29f90da04b82 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:03.407707 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f50dc5ac-52dd-481e-b541-29f90da04b82 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:03.438077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f50dc5ac-52dd-481e-b541-29f90da04b82 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063144 Aug 10 11:21:03.438682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 343/696] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:21:03 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:21:03.505243 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:03.505819 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:03.515532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:03.516487 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:03.517222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:03.518269 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:03.518981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:03.519405 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:03.546850 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:21:03.630126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-55bfd4a7-b013-45db-8681-9285cdb5920f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 204 len: 0 microversion: 2.1 time: 0.128643 Aug 10 11:21:03.630712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 354/697] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:21:03 2022] DELETE /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:21:03.640361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:03.641229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:03.651836 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:03.652625 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:03.653064 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:03.653905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:03.654357 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:03.654814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:03.797466 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:03.805611 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1a623230-7bf6-441b-a8b8-cfa2e7021612 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1680 microversion: 2.1 time: 0.169431 Aug 10 11:21:03.806187 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 344/698] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:03 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:21:04.827711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:04.828527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:04.835152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:04.835853 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:04.836291 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:04.837171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:04.837804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:04.838072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:04.971437 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:04.981035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c910101e-2f09-4706-9d45-071dbceb9ce1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1680 microversion: 2.1 time: 0.157339 Aug 10 11:21:04.981614 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 355/699] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:04 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:06.002629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:06.003237 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:06.010296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:06.010812 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:06.011243 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:06.011927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:06.012378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:06.012800 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:06.454960 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:06.462375 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c73ac8bd-f409-44ab-85b9-15064396bd35 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1680 microversion: 2.1 time: 0.463653 Aug 10 11:21:06.462966 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 345/700] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:05 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1680 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:07.176106 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-6fa4eb4c-8e3a-4a7e-bdeb-5c667ca8d4a9 req-1dafb6f1-1913-4f68-a8b1-555635556f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8547aa0-1882-4f7e-8f8c-971de45eb907", "name": "network-vif-deleted", "tag": "6b9a2d77-fe7a-40a8-add0-b53ef8501f4b"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:07.193354 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-6fa4eb4c-8e3a-4a7e-bdeb-5c667ca8d4a9 req-1dafb6f1-1913-4f68-a8b1-555635556f63 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:07.193980 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-6fa4eb4c-8e3a-4a7e-bdeb-5c667ca8d4a9 req-1dafb6f1-1913-4f68-a8b1-555635556f63 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:07.194511 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-6fa4eb4c-8e3a-4a7e-bdeb-5c667ca8d4a9 req-1dafb6f1-1913-4f68-a8b1-555635556f63 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:07.205933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-6fa4eb4c-8e3a-4a7e-bdeb-5c667ca8d4a9 req-1dafb6f1-1913-4f68-a8b1-555635556f63 service nova] Creating event network-vif-deleted:6b9a2d77-fe7a-40a8-add0-b53ef8501f4b for instance f8547aa0-1882-4f7e-8f8c-971de45eb907 on hv-cinder-85272 Aug 10 11:21:07.211998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-6fa4eb4c-8e3a-4a7e-bdeb-5c667ca8d4a9 req-1dafb6f1-1913-4f68-a8b1-555635556f63 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039274 Aug 10 11:21:07.212874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 356/701] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:07.484115 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:07.484730 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:07.491247 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:07.491762 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:07.492200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:07.492926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:07.493426 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:07.493874 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:07.525759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:07.526248 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:07.526716 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:07.527164 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lazy-loading 'fault' on Instance uuid f8547aa0-1882-4f7e-8f8c-971de45eb907 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:21:07.585768 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:07.594240 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b20d2c18-61da-4efc-9313-94b81941781f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 200 len: 1330 microversion: 2.1 time: 0.113863 Aug 10 11:21:07.595043 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 346/702] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:07 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:08.617165 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:08.617986 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:08.624171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:08.624662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:08.625095 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:08.625790 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:08.626242 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:08.626697 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:08.654035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 HTTP/1.1 Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:21:08.655734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:21:08.657166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': 'f8547aa0-1882-4f7e-8f8c-971de45eb907'} Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:21:08.658023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:21:08.659396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:21:08.660483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:21:08.660483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-24fead43-8d7a-47eb-9cf5-d1edceb4831c tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 404 len: 111 microversion: 2.1 time: 0.044734 Aug 10 11:21:08.660483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 357/703] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:08 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:21:08.666087 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55126cef-7cab-4f25-bae4-ac0a265a6a78 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '.version_select at 0x7fccf2ffc160>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:08.691079 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-55126cef-7cab-4f25-bae4-ac0a265a6a78 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143361916" status: 202 len: 0 microversion: 2.1 time: 0.028439 Aug 10 11:21:08.692145 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 347/704] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 10 11:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143361916 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:21:09.348403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5fcdb3d5-ad0b-4dde-9738-9bd1ec80000d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: .version_select at 0x7fccf8132dc0>, body: {"keypair": {"name": "tempest-keypair-1609024536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjEtkDL+vntO4KJSLINSGsjFSJCiED0ZIGAsKJB306C0wDxynwMf90Ra5Uk1wYFcan83lPAiMtlvNai3ha1B1XquyhbWoYhdk8/HGDN1pyocoA4BYIYknDZg8bEWhfWxg=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:09.365509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-5fcdb3d5-ad0b-4dde-9738-9bd1ec80000d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:21:09.369450 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-5fcdb3d5-ad0b-4dde-9738-9bd1ec80000d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for user 0a30897a10d8467aa294f24954368a84 and project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:21:09.391324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5fcdb3d5-ad0b-4dde-9738-9bd1ec80000d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046882 Aug 10 11:21:09.391914 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 358/705] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:21:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:10.681409 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:10.687125 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-51150562", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7551c29-e5c9-4c19-8306-42621bf3d395"}], "security_groups": [{"name": "tempest-securitygroup--726167370"}], "key_name": "tempest-keypair-1609024536", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:10.791739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] validate_networks() for [('b7551c29-e5c9-4c19-8306-42621bf3d395', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:21:11.166050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:21:11.166477 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:21:11.166979 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:21:11.167393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:21:11.167809 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:21:11.177978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:11.178979 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:11.179415 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:11.180143 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:11.180599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:11.181026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:11.199222 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:21:11.203197 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Getting quotas for user 0a30897a10d8467aa294f24954368a84 and project 47d9cb4aa3484f95bad54f2233a08439. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:21:11.213962 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:21:11.216252 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:21:11.262013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a4700f11-6257-4185-9bc4-3682ac775a47 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.581886 Aug 10 11:21:11.262962 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 348/706] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:21:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:21:11.273740 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6fa082b3-a3f4-4f54-a450-c1a7f3bb1b67 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:11.274336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6fa082b3-a3f4-4f54-a450-c1a7f3bb1b67 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:11.328466 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6fa082b3-a3f4-4f54-a450-c1a7f3bb1b67 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:11.335815 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6fa082b3-a3f4-4f54-a450-c1a7f3bb1b67 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1240 microversion: 2.1 time: 0.065738 Aug 10 11:21:11.336386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 359/707] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:11 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:12.357956 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:12.359123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:12.368172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:12.369718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:12.369718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:12.370102 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:12.371028 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:12.371475 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:12.440761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:12.449098 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7616af01-f5b0-441e-8f60-9579e3513730 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1310 microversion: 2.1 time: 0.096346 Aug 10 11:21:12.449779 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 349/708] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:12 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:21:13.469947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:13.470562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:13.477370 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:13.477882 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:13.478296 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:13.479037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:13.479493 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:13.479920 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:13.681208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:13.687793 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1fbbb6cf-42af-424c-b6f5-85e2b774c977 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1365 microversion: 2.1 time: 0.221622 Aug 10 11:21:13.688370 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 360/709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:13 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:13.760929 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a95bd118-b63b-43e4-a91c-f4c28f86c169 req-a849dfc0-7243-447f-9954-ba0a3fbf6c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3620ef46-8dfe-419a-88b2-d8e25e9e9ca8", "tag": "c98c9742-65a1-4765-87f9-866c658b4e79"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:13.771419 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a95bd118-b63b-43e4-a91c-f4c28f86c169 req-a849dfc0-7243-447f-9954-ba0a3fbf6c5e service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:13.772000 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a95bd118-b63b-43e4-a91c-f4c28f86c169 req-a849dfc0-7243-447f-9954-ba0a3fbf6c5e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:13.772764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a95bd118-b63b-43e4-a91c-f4c28f86c169 req-a849dfc0-7243-447f-9954-ba0a3fbf6c5e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:13.785588 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a95bd118-b63b-43e4-a91c-f4c28f86c169 req-a849dfc0-7243-447f-9954-ba0a3fbf6c5e service nova] Creating event network-changed:c98c9742-65a1-4765-87f9-866c658b4e79 for instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 on hv-cinder-85272 Aug 10 11:21:13.791016 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a95bd118-b63b-43e4-a91c-f4c28f86c169 req-a849dfc0-7243-447f-9954-ba0a3fbf6c5e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034494 Aug 10 11:21:13.791701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 350/710] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:14.710260 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:14.710892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:14.719920 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:14.720645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:14.721297 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:14.722385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:14.723121 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:14.723776 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:14.866773 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:14.874243 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7c335c0c-94b9-4415-9cb8-eabefc311530 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1365 microversion: 2.1 time: 0.168568 Aug 10 11:21:14.874825 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 361/711] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:14 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:15.895870 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:15.896609 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:15.903235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:15.903719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:15.904160 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:15.904853 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:15.905310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:15.905736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:16.037215 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:16.045619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-57c89d76-5157-4e3d-9876-573669adcab1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1365 microversion: 2.1 time: 0.154380 Aug 10 11:21:16.046192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 351/712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:15 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:17.066193 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:17.066825 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:17.073925 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:17.074434 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:17.074905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:17.075595 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:17.076071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:17.076495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:17.203427 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:17.210843 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1e48cee4-8acd-4197-84f4-a1f9e62e4f53 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1365 microversion: 2.1 time: 0.148454 Aug 10 11:21:17.211405 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 362/713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:17 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:18.231937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:18.232576 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:18.239073 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:18.239564 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:18.240004 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:18.240717 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:18.241175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:18.241602 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:18.686392 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:18.695171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5450e58-f53f-4212-a1dd-9880d733710d tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1365 microversion: 2.1 time: 0.467000 Aug 10 11:21:18.695836 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 352/714] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:18 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1365 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:19.716163 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:19.716799 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:19.723215 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:19.723694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:19.724129 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:19.724814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:19.725889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:19.726320 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:19.853717 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:19.859270 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f7f8979f-7bf4-4c2e-8762-1fad8a2e0cc9 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1365 microversion: 2.1 time: 0.146951 Aug 10 11:21:19.859843 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 363/715] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:19 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:20.637932 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-603dc219-090f-4d42-8f94-523a8a1be7c3 req-dff23812-4c13-4bc0-b429-0d69fb9ae91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3620ef46-8dfe-419a-88b2-d8e25e9e9ca8", "name": "network-vif-plugged", "status": "completed", "tag": "c98c9742-65a1-4765-87f9-866c658b4e79"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:20.650070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-603dc219-090f-4d42-8f94-523a8a1be7c3 req-dff23812-4c13-4bc0-b429-0d69fb9ae91a service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:20.650561 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-603dc219-090f-4d42-8f94-523a8a1be7c3 req-dff23812-4c13-4bc0-b429-0d69fb9ae91a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:20.651356 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-603dc219-090f-4d42-8f94-523a8a1be7c3 req-dff23812-4c13-4bc0-b429-0d69fb9ae91a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:20.662177 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-603dc219-090f-4d42-8f94-523a8a1be7c3 req-dff23812-4c13-4bc0-b429-0d69fb9ae91a service nova] Creating event network-vif-plugged:c98c9742-65a1-4765-87f9-866c658b4e79 for instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 on hv-cinder-85272 Aug 10 11:21:20.667152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-603dc219-090f-4d42-8f94-523a8a1be7c3 req-dff23812-4c13-4bc0-b429-0d69fb9ae91a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032916 Aug 10 11:21:20.667780 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 353/716] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:20.879539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:20.880174 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:20.887110 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:20.887922 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:20.888357 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:20.889049 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:20.889497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:20.889915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:21.040060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:21.047411 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3b06712f-9a10-40f2-80f6-0b81c9359eda tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1365 microversion: 2.1 time: 0.171655 Aug 10 11:21:21.047976 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 364/717] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:20 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:21:22.069991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:22.070720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:22.072686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:22.073342 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:22.079638 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:22.080121 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:22.080556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:22.081252 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:22.081708 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:22.082131 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:22.211227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:22.218623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6aa64104-f66e-41e4-ba2d-2645a0ce2f7a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1365 microversion: 2.1 time: 0.153607 Aug 10 11:21:22.219188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 354/718] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:22 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:23.239577 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:23.240206 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:23.242890 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:23.248439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:23.248964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:23.249417 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:23.250053 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:23.250498 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:23.250945 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:23.382023 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:23.389988 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a0eae955-8659-4591-98f2-4656c1695dd6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1555 microversion: 2.1 time: 0.154401 Aug 10 11:21:23.390547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 365/719] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:23 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:23.410049 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1d40fb1d-22ec-40ff-993d-8780903696a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:23.410548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1d40fb1d-22ec-40ff-993d-8780903696a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:23.413072 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:23.418280 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d40fb1d-22ec-40ff-993d-8780903696a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:23.418803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d40fb1d-22ec-40ff-993d-8780903696a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:23.419242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d40fb1d-22ec-40ff-993d-8780903696a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:23.419971 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d40fb1d-22ec-40ff-993d-8780903696a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:23.420426 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d40fb1d-22ec-40ff-993d-8780903696a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:23.420854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d40fb1d-22ec-40ff-993d-8780903696a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:23.425614 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:23.460285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2081848059", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2130847063", "security_groups": [{"name": "tempest-secgroup-smoke-1988058395"}], "networks": [{"uuid": "c5749e84-64e5-4030-b8cc-bebe008962ab"}], "block_device_mapping_v2": [{"uuid": "7d70b497-292a-440d-97fa-05c0424d3a0f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:23.501102 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1d40fb1d-22ec-40ff-993d-8780903696a0 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094810 Aug 10 11:21:23.501699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 355/720] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 11:21:23 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:23.674025 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] validate_networks() for [('c5749e84-64e5-4030-b8cc-bebe008962ab', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:21:24.017869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:24.378597 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:21:24.379137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:21:24.379674 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:21:24.380148 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:21:24.380659 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:21:24.389993 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:24.390478 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:24.390953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:24.391669 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:24.392121 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:24.392539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:24.399743 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:24.411952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Getting quotas for project 5fa6be82e0004c208037e16b0bfc23a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:21:24.415820 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Getting quotas for user 1734d2f354a247d680f3c6fe7071632c and project 5fa6be82e0004c208037e16b0bfc23a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:21:24.488172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:21:24.490214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d70b497-292a-440d-97fa-05c0424d3a0f',volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:21:24.622774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fc249fed-8d5b-4398-9a66-4d3dcbb8b01b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.166286 Aug 10 11:21:24.629171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 366/721] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:21:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:21:24.635099 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f4fbae38-f4da-4f79-98cc-959696375164 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:24.648167 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f4fbae38-f4da-4f79-98cc-959696375164 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:24.723301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f4fbae38-f4da-4f79-98cc-959696375164 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:24.732158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f4fbae38-f4da-4f79-98cc-959696375164 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1089 microversion: 2.1 time: 0.101131 Aug 10 11:21:24.732983 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 356/722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:24 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1089 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:21:24.775828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5250e1b9-91f7-463f-9668-4e9097d8f993 req-69219774-dc0a-41bc-97cc-42a8d3c9eddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3620ef46-8dfe-419a-88b2-d8e25e9e9ca8", "tag": "c98c9742-65a1-4765-87f9-866c658b4e79"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:24.785413 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5250e1b9-91f7-463f-9668-4e9097d8f993 req-69219774-dc0a-41bc-97cc-42a8d3c9eddf service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:24.785892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5250e1b9-91f7-463f-9668-4e9097d8f993 req-69219774-dc0a-41bc-97cc-42a8d3c9eddf service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:24.786322 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5250e1b9-91f7-463f-9668-4e9097d8f993 req-69219774-dc0a-41bc-97cc-42a8d3c9eddf service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:24.797826 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5250e1b9-91f7-463f-9668-4e9097d8f993 req-69219774-dc0a-41bc-97cc-42a8d3c9eddf service nova] Creating event network-changed:c98c9742-65a1-4765-87f9-866c658b4e79 for instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 on hv-cinder-85272 Aug 10 11:21:24.805830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5250e1b9-91f7-463f-9668-4e9097d8f993 req-69219774-dc0a-41bc-97cc-42a8d3c9eddf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033557 Aug 10 11:21:24.806458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 367/723] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:25.753279 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:25.753924 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:25.761676 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:25.762091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:25.762525 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:25.763299 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:25.763752 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:25.764206 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:25.828918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:25.838846 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a3ecab6a-576e-4e2d-ac38-0d3e794e3ee1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1187 microversion: 2.1 time: 0.089326 Aug 10 11:21:25.839679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 357/724] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:25 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:26.860604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:26.861514 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:26.868484 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:26.868967 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:26.869397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:26.870095 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:26.870543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:26.870989 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:27.068674 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:27.076368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cb4d8bd5-d54f-4b2d-8a7c-7fe967ca4c58 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.220465 Aug 10 11:21:27.076931 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 368/725] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:26 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:27.601058 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-fb307424-73ae-4cd3-ac30-be7402d8b2ff req-b832709f-d861-4a84-a3a6-42a841180252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210aa1a7-389f-4708-9b3a-e0919befdaef", "tag": "0764a841-f90a-4927-a828-061ea8c8bf8c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:27.611947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fb307424-73ae-4cd3-ac30-be7402d8b2ff req-b832709f-d861-4a84-a3a6-42a841180252 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:27.612710 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fb307424-73ae-4cd3-ac30-be7402d8b2ff req-b832709f-d861-4a84-a3a6-42a841180252 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:27.613401 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fb307424-73ae-4cd3-ac30-be7402d8b2ff req-b832709f-d861-4a84-a3a6-42a841180252 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:27.624450 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-fb307424-73ae-4cd3-ac30-be7402d8b2ff req-b832709f-d861-4a84-a3a6-42a841180252 service nova] Creating event network-changed:0764a841-f90a-4927-a828-061ea8c8bf8c for instance 210aa1a7-389f-4708-9b3a-e0919befdaef on hv-cinder-85272 Aug 10 11:21:27.629112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-fb307424-73ae-4cd3-ac30-be7402d8b2ff req-b832709f-d861-4a84-a3a6-42a841180252 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031812 Aug 10 11:21:27.629710 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 358/726] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:28.097495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:28.098108 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:28.104963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:28.105449 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:28.105891 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:28.106646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:28.107103 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:28.107533 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:28.242629 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:28.249999 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-25edfe03-564f-458f-85c9-d71e2d96f887 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.156412 Aug 10 11:21:28.250556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 369/727] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:28 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:21:29.271988 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:29.272677 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:29.278711 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:29.279197 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:29.279635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:29.280316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:29.280766 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:29.281185 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:29.480279 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:29.487881 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d73ecb05-8cb0-4da2-8113-50b8786fde02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.220503 Aug 10 11:21:29.488591 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 359/728] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:29 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:30.509217 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:30.509858 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:30.516318 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:30.516803 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:30.517248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:30.517939 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:30.518395 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:30.518861 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:30.646843 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:30.654324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e1cb3cd6-851c-4eef-aff6-7f9792036e9a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.149467 Aug 10 11:21:30.654919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 370/729] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:30 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:31.675377 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:31.676064 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:31.682253 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:31.682774 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:31.683341 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:31.684044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:31.684523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:31.684918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:31.814501 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:31.823241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-490b4748-a6f2-44e4-baf8-2149f5875b44 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.152286 Aug 10 11:21:31.823812 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 360/730] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:31 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:32.843085 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:32.843684 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:32.850062 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:32.850531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:32.851110 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:32.851811 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:32.852759 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:32.853185 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:32.980884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:32.988277 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cc11e48f-3eb8-43ba-9d4d-f7059d1b7710 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.149159 Aug 10 11:21:32.988831 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 371/731] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:32 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:34.009481 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:34.010111 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:34.016509 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:34.016985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:34.017414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:34.018097 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:34.018546 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:34.018991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:34.155156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:34.162468 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8961dea-bcc5-4fdf-aca3-b6a4e9916d52 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.157321 Aug 10 11:21:34.163059 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 361/732] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:34 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:35.183282 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:35.183828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:35.186208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:35.186900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:35.192402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:35.192883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:35.193314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:35.194000 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:35.194747 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:35.195171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:35.323519 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:35.330893 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1c7f5b37-d527-490c-b658-cdb97c82bc3d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.152072 Aug 10 11:21:35.331452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 372/733] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:35 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:36.351369 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:36.352477 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:36.355569 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:36.362528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:36.363031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:36.363457 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:36.364141 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:36.364588 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:36.365008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:36.490815 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:36.498672 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1dee6d18-8d2d-4674-bcf8-1a13cec47160 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.151112 Aug 10 11:21:36.499230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 362/734] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:36 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:37.520103 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:37.520659 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:37.527183 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:37.527657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:37.528087 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:37.528767 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:37.529215 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:37.529632 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:37.661379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:37.668933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1acea420-0966-4eea-a6bd-ae168490dee2 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.152728 Aug 10 11:21:37.669490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 373/735] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:37 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:38.679913 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d16cb669-0e80-4329-9df9-c6463e7d31d1 req-e1162d69-5947-4b87-b6b4-0e9ac5231638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210aa1a7-389f-4708-9b3a-e0919befdaef", "name": "network-vif-plugged", "status": "completed", "tag": "0764a841-f90a-4927-a828-061ea8c8bf8c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:38.690079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:38.690696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d16cb669-0e80-4329-9df9-c6463e7d31d1 req-e1162d69-5947-4b87-b6b4-0e9ac5231638 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:38.690942 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d16cb669-0e80-4329-9df9-c6463e7d31d1 req-e1162d69-5947-4b87-b6b4-0e9ac5231638 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:38.691235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d16cb669-0e80-4329-9df9-c6463e7d31d1 req-e1162d69-5947-4b87-b6b4-0e9ac5231638 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:38.692206 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:38.699382 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:38.699876 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:38.700413 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:38.701126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:38.701911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:38.702346 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:38.703427 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d16cb669-0e80-4329-9df9-c6463e7d31d1 req-e1162d69-5947-4b87-b6b4-0e9ac5231638 service nova] Creating event network-vif-plugged:0764a841-f90a-4927-a828-061ea8c8bf8c for instance 210aa1a7-389f-4708-9b3a-e0919befdaef on hv-cinder-85272 Aug 10 11:21:38.709983 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d16cb669-0e80-4329-9df9-c6463e7d31d1 req-e1162d69-5947-4b87-b6b4-0e9ac5231638 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033713 Aug 10 11:21:38.711102 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 363/736] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:38.837811 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:38.845228 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5966058d-f6e9-4365-90eb-9a6a4bf0db00 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.159800 Aug 10 11:21:38.845788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 374/737] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:38 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:21:39.866628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:39.867092 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:39.874050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:39.874538 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:39.875005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:39.875709 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:39.876166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:39.876593 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:40.006872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:40.014604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d887b700-3e99-439f-bb8d-af7deedfaac8 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1261 microversion: 2.1 time: 0.153011 Aug 10 11:21:40.015175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 364/738] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:39 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:41.035965 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:41.036524 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:41.043311 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:41.043799 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:41.044264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:41.044964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:41.045420 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:41.045873 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:41.173619 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:41.181563 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5998cadc-92a0-43f3-96a3-c0c25c2d7232 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1445 microversion: 2.1 time: 0.149624 Aug 10 11:21:41.182122 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 375/739] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:41 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:41.201692 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:41.202307 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:41.208595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:41.209079 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:41.209514 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:41.210209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:41.210692 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:41.211123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:41.343730 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:41.351103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3e6a5148-40b6-454d-87c3-0912abca0c79 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1445 microversion: 2.1 time: 0.153296 Aug 10 11:21:41.351666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 365/740] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:41 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:43.237214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-c409db07-cb9a-4127-b59d-0eb8d9f92e98 req-3a6cce6b-5466-4859-956b-1bfd3a0604db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210aa1a7-389f-4708-9b3a-e0919befdaef", "tag": "0764a841-f90a-4927-a828-061ea8c8bf8c"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:43.247705 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c409db07-cb9a-4127-b59d-0eb8d9f92e98 req-3a6cce6b-5466-4859-956b-1bfd3a0604db service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:43.248166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c409db07-cb9a-4127-b59d-0eb8d9f92e98 req-3a6cce6b-5466-4859-956b-1bfd3a0604db service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:43.248590 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c409db07-cb9a-4127-b59d-0eb8d9f92e98 req-3a6cce6b-5466-4859-956b-1bfd3a0604db service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:43.261549 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-c409db07-cb9a-4127-b59d-0eb8d9f92e98 req-3a6cce6b-5466-4859-956b-1bfd3a0604db service nova] Creating event network-changed:0764a841-f90a-4927-a828-061ea8c8bf8c for instance 210aa1a7-389f-4708-9b3a-e0919befdaef on hv-cinder-85272 Aug 10 11:21:43.266554 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-c409db07-cb9a-4127-b59d-0eb8d9f92e98 req-3a6cce6b-5466-4859-956b-1bfd3a0604db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032957 Aug 10 11:21:43.267172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 376/741] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:52.346097 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-766000080", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800106665", "security_groups": [{"name": "tempest-secgroup-smoke-874089438"}], "block_device_mapping_v2": [{"uuid": "1b803c47-e9cf-4c36-8d44-bcda3b6cb98c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6731bf27-4e34-48cb-9d42-c4bbb5a3efbd"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:52.357095 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=23 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:52.357793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=49 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:52.471336 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] validate_networks() for [('6731bf27-4e34-48cb-9d42-c4bbb5a3efbd', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:21:52.855329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:21:52.855833 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:21:52.856413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:21:52.856893 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:21:52.857378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:21:52.866462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:52.866965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:52.867542 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:52.869306 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:52.869860 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:52.870296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:52.887164 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Getting quotas for project 79389800e0ea49d3b5abfbefe17960ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:21:52.891099 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Getting quotas for user 7ebc052a3cb6400a961c1b9d9bec83d6 and project 79389800e0ea49d3b5abfbefe17960ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:21:52.947792 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:21:52.949842 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b803c47-e9cf-4c36-8d44-bcda3b6cb98c',volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:21:53.090890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3f0ffabe-488a-4661-bf27-01dd82a96ed0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.748671 Aug 10 11:21:53.091517 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 366/742] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:21:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:21:53.103381 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-24f365a2-e769-4c37-826f-cc80711dadea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:53.104078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-24f365a2-e769-4c37-826f-cc80711dadea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:53.165164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-24f365a2-e769-4c37-826f-cc80711dadea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:53.171760 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-24f365a2-e769-4c37-826f-cc80711dadea tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1093 microversion: 2.1 time: 0.073192 Aug 10 11:21:53.172322 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 377/743] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:53 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:54.192992 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:54.193699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:54.201418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:54.201922 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:54.202365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:54.203107 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:54.203569 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:54.204001 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:54.278184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:54.285564 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f39065aa-c7ee-4e8c-b550-5bcdcd251e4b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1209 microversion: 2.1 time: 0.097084 Aug 10 11:21:54.286122 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 367/744] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:54 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:55.307128 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:55.307659 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:55.309921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=53 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:55.311247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:55.318663 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:55.319165 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:55.319606 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:55.320660 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:55.321635 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:55.322072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:55.563968 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:55.572474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b3e25bfa-6c3f-420c-b91a-775583179b3c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.269354 Aug 10 11:21:55.573060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 378/745] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:55 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:55.705407 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8b6a8742-7349-4d40-a788-364dc64bde70 req-ce077f05-cbe1-467f-9db4-c86a829db862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dcec59e-6d2c-4ed9-8e46-041d636a208a", "tag": "14591c2b-ed56-404b-961a-a9175299d402"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:21:55.715539 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8b6a8742-7349-4d40-a788-364dc64bde70 req-ce077f05-cbe1-467f-9db4-c86a829db862 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:55.716031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8b6a8742-7349-4d40-a788-364dc64bde70 req-ce077f05-cbe1-467f-9db4-c86a829db862 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:55.716466 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8b6a8742-7349-4d40-a788-364dc64bde70 req-ce077f05-cbe1-467f-9db4-c86a829db862 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:55.729455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8b6a8742-7349-4d40-a788-364dc64bde70 req-ce077f05-cbe1-467f-9db4-c86a829db862 service nova] Creating event network-changed:14591c2b-ed56-404b-961a-a9175299d402 for instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a on hv-cinder-85272 Aug 10 11:21:55.734426 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8b6a8742-7349-4d40-a788-364dc64bde70 req-ce077f05-cbe1-467f-9db4-c86a829db862 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Aug 10 11:21:55.735074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 368/746] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:21:56.593782 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:56.594386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:56.600797 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:56.601273 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:56.601702 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:56.602452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:56.602924 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:56.603343 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:56.739459 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:56.746874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1c91930c-6c9c-474c-b6de-c54922823fe6 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.156877 Aug 10 11:21:56.747439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 379/747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:56 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:21:57.768731 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:57.769442 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:57.776127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:57.776630 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:57.777075 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:57.777810 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:57.778270 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:57.778737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:57.917500 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:57.924905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0018257b-d81f-4495-be24-b493de7dd7e8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.160907 Aug 10 11:21:57.925469 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 369/748] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:57 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:21:58.945679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:21:58.946290 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:21:58.952723 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:58.953208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:58.953649 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:58.954340 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:58.954825 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:58.955259 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:59.084129 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:21:59.091542 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5e45ec46-27f8-4614-a2b2-01406b15f061 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.150079 Aug 10 11:21:59.092104 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 380/749] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:21:58 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:00.112758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:00.113365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:00.120443 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:00.120864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:00.121296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:00.121986 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:00.122442 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:00.122892 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:00.269662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:00.277412 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-50021c69-5c6b-4809-ab9d-12637993fc8e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.168573 Aug 10 11:22:00.277999 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 370/750] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:00 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:01.300907 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:01.301580 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:01.308051 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:01.308540 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:01.308979 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:01.309682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:01.310140 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:01.310568 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:01.470304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:01.478478 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-779e0e75-85d7-46c2-a092-5fad75286a0b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.181548 Aug 10 11:22:01.479076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 381/751] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:01 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:02.499342 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:02.499976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:02.506045 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:02.506522 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:02.506986 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:02.507667 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:02.508115 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:02.509128 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:02.641196 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:02.648626 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2863e3a-09cb-489c-9745-77911d4d0786 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.153091 Aug 10 11:22:02.649192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 371/752] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:02 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:03.669170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:03.669774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:03.672429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:03.678340 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:03.678858 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:03.679299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:03.680000 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:03.680942 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:03.681367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:03.813076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:03.821967 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-39a0247d-0ec7-4550-ba99-82a081a67985 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.155973 Aug 10 11:22:03.822594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 382/753] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:03 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:04.843185 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:04.843776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:04.845729 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:04.846840 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:04.852525 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:04.853025 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:04.853470 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:04.854180 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:04.854669 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:04.855101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:04.986746 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:04.994733 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-17f2dd61-1de0-4590-ad41-6825bb800c1b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.155498 Aug 10 11:22:04.995293 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 372/754] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:04 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:06.015324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:06.015946 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:06.022246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:06.022767 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:06.023215 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:06.023912 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:06.024859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:06.025286 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:06.190936 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:06.199317 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8faa1056-4f69-4af2-8dcb-337dc50442ab tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.187860 Aug 10 11:22:06.199987 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 383/755] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:06 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:06.812650 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c6b7c281-2c91-43a6-9a6c-5c4942336b73 req-edfa643f-d310-4266-af4a-c71087957346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dcec59e-6d2c-4ed9-8e46-041d636a208a", "name": "network-vif-plugged", "status": "completed", "tag": "14591c2b-ed56-404b-961a-a9175299d402"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:06.825257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c6b7c281-2c91-43a6-9a6c-5c4942336b73 req-edfa643f-d310-4266-af4a-c71087957346 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:06.825742 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c6b7c281-2c91-43a6-9a6c-5c4942336b73 req-edfa643f-d310-4266-af4a-c71087957346 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:06.826173 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c6b7c281-2c91-43a6-9a6c-5c4942336b73 req-edfa643f-d310-4266-af4a-c71087957346 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:06.837516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c6b7c281-2c91-43a6-9a6c-5c4942336b73 req-edfa643f-d310-4266-af4a-c71087957346 service nova] Creating event network-vif-plugged:14591c2b-ed56-404b-961a-a9175299d402 for instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a on hv-cinder-85272 Aug 10 11:22:06.842732 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c6b7c281-2c91-43a6-9a6c-5c4942336b73 req-edfa643f-d310-4266-af4a-c71087957346 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 Aug 10 11:22:06.843332 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 373/756] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:07.220306 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:07.220918 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:07.227775 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:07.228258 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:07.228689 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:07.229379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:07.229840 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:07.230261 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:07.364584 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:07.372711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2c35bb49-ee78-46c0-9251-9960b920102f tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.156296 Aug 10 11:22:07.373280 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 384/757] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:07 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:08.393610 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:08.394314 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:08.401420 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:08.401906 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:08.402334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:08.403103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:08.403550 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:08.403972 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:08.535948 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:08.543585 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-af85f963-a4a2-4fd0-a219-b4d6fbd5f30b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1264 microversion: 2.1 time: 0.154147 Aug 10 11:22:08.544156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 374/758] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:08 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:09.563781 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:09.564395 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:09.571630 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:09.572125 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:09.572567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:09.573264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:09.573724 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:09.574150 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:09.707780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:09.715984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fec60e64-d990-4134-a354-a4cfe83fc75e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1451 microversion: 2.1 time: 0.156097 Aug 10 11:22:09.716561 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 385/759] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:09 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:09.736159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:09.736779 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:09.743171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:09.743662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:09.744103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:09.744819 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:09.745283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:09.745711 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:09.875136 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:09.882634 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e23fd8b1-5211-4e60-a728-6d6954caa87e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1451 microversion: 2.1 time: 0.150248 Aug 10 11:22:09.883207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 375/760] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:09 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:11.826744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-fe219ac9-2bac-4731-857d-1bd2b7e20112 req-2d2803ff-476a-4e3c-bbd2-b530b4ed05eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dcec59e-6d2c-4ed9-8e46-041d636a208a", "tag": "14591c2b-ed56-404b-961a-a9175299d402"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:11.836702 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-fe219ac9-2bac-4731-857d-1bd2b7e20112 req-2d2803ff-476a-4e3c-bbd2-b530b4ed05eb service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:11.837180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-fe219ac9-2bac-4731-857d-1bd2b7e20112 req-2d2803ff-476a-4e3c-bbd2-b530b4ed05eb service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:11.837608 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-fe219ac9-2bac-4731-857d-1bd2b7e20112 req-2d2803ff-476a-4e3c-bbd2-b530b4ed05eb service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:11.850339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-fe219ac9-2bac-4731-857d-1bd2b7e20112 req-2d2803ff-476a-4e3c-bbd2-b530b4ed05eb service nova] Creating event network-changed:14591c2b-ed56-404b-961a-a9175299d402 for instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a on hv-cinder-85272 Aug 10 11:22:11.856525 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-fe219ac9-2bac-4731-857d-1bd2b7e20112 req-2d2803ff-476a-4e3c-bbd2-b530b4ed05eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033416 Aug 10 11:22:11.857138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 386/761] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:13.442192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eed7fd30-0c77-4aac-b114-8f025c0118e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:13.442785 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eed7fd30-0c77-4aac-b114-8f025c0118e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:13.450221 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eed7fd30-0c77-4aac-b114-8f025c0118e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:13.450755 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eed7fd30-0c77-4aac-b114-8f025c0118e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:13.451200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eed7fd30-0c77-4aac-b114-8f025c0118e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:13.451903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eed7fd30-0c77-4aac-b114-8f025c0118e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:13.452362 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eed7fd30-0c77-4aac-b114-8f025c0118e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:13.452793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eed7fd30-0c77-4aac-b114-8f025c0118e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:13.475954 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eed7fd30-0c77-4aac-b114-8f025c0118e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/ips" status: 200 len: 153 microversion: 2.20 time: 0.037559 Aug 10 11:22:13.476457 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 376/762] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 10 11:22:13 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:22:15.331015 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:15.331562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:15.338450 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:15.338952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:15.339388 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:15.340078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:15.340532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:15.341051 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:15.362965 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lazy-loading 'flavor' on Instance uuid 00252e7d-b9e4-4476-a984-b33aa7286520 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:22:15.539410 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ae0f3142-639a-4685-b062-2b28d1d75864 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/action" status: 202 len: 0 microversion: 2.20 time: 0.213261 Aug 10 11:22:15.540155 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 387/763] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 10 11:22:15 2022] POST /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:22:15.548722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:15.549347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:15.556153 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:15.556656 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:15.557140 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:15.557815 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:15.558265 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:15.558724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:15.689522 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:15.697878 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:15.699439 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:15.700589 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d9c44ab0-bd4f-44f2-9346-6eb2c12fef03 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.156138 Aug 10 11:22:15.701155 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 377/764] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:15 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:16.415626 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3eb9b5e3-69a0-4e3c-afe8-d8d388242aec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:16.416213 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3eb9b5e3-69a0-4e3c-afe8-d8d388242aec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:16.423383 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eb9b5e3-69a0-4e3c-afe8-d8d388242aec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:16.423879 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eb9b5e3-69a0-4e3c-afe8-d8d388242aec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:16.424313 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eb9b5e3-69a0-4e3c-afe8-d8d388242aec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:16.425552 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eb9b5e3-69a0-4e3c-afe8-d8d388242aec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:16.426017 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eb9b5e3-69a0-4e3c-afe8-d8d388242aec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:16.426453 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3eb9b5e3-69a0-4e3c-afe8-d8d388242aec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:16.451779 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3eb9b5e3-69a0-4e3c-afe8-d8d388242aec tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/ips" status: 200 len: 146 microversion: 2.1 time: 0.041534 Aug 10 11:22:16.452361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 388/765] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:22:16 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:16.723135 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:16.723685 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:16.730906 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:16.731403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:16.731848 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:16.732560 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:16.733017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:16.733450 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:16.870140 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:16.878281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:16.879868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:16.881084 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0242f81d-cf5d-4746-b2c6-a43de0e639e7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.161919 Aug 10 11:22:16.881653 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 378/766] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:16 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:17.789117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-08ef9f2a-b3a5-462f-ab57-f15863d4723c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41507c1d-1747-48e1-b9a8-4a667636cd92"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:17.791486 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-08ef9f2a-b3a5-462f-ab57-f15863d4723c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:17.797770 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08ef9f2a-b3a5-462f-ab57-f15863d4723c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:17.798247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08ef9f2a-b3a5-462f-ab57-f15863d4723c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:17.798709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08ef9f2a-b3a5-462f-ab57-f15863d4723c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:17.799392 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08ef9f2a-b3a5-462f-ab57-f15863d4723c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:17.799838 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08ef9f2a-b3a5-462f-ab57-f15863d4723c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:17.800257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08ef9f2a-b3a5-462f-ab57-f15863d4723c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:17.905330 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:17.907441 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:17.912933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:17.913430 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:17.914142 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:17.915178 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:17.915659 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:17.916092 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:18.057198 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:18.065569 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:18.067126 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:18.068272 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-32a1f6da-5cf4-4e3c-bdad-abb75bee9835 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.166849 Aug 10 11:22:18.068833 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 379/767] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:17 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:22:18.083410 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-08ef9f2a-b3a5-462f-ab57-f15863d4723c tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298083 Aug 10 11:22:18.084009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 389/768] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:22:17 2022] POST /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:22:19.093414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:19.093978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:19.100493 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:19.100981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:19.101423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:19.102118 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:19.103104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:19.103530 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:19.235093 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:19.242991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:19.244989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:19.246142 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3f3364fb-79e4-4f90-997d-2463ca7824c4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.156778 Aug 10 11:22:19.246874 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 380/769] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:19 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:20.269799 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:20.270521 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:20.276775 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:20.277261 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:20.277698 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:20.278394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:20.278874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:20.279304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:20.411189 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:20.419677 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:20.421181 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:20.422335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9512b369-6390-4929-9f65-824aaa9d36e3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.157320 Aug 10 11:22:20.422934 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 390/770] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:20 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:21.445151 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:21.445787 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:21.453894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:21.454375 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:21.454832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:21.455526 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:21.455981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:21.456399 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:21.608088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:21.616084 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:21.617601 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:21.619398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1cf2f1f9-f129-47f5-91e2-566c878b85d4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.177855 Aug 10 11:22:21.620004 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 381/771] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:21 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:22.642702 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:22.643326 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:22.649720 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:22.650194 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:22.650646 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:22.651331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:22.651780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:22.652196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:22.941535 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:22.950189 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:22.951751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:22.952907 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a02e2a79-1e65-4b6a-8000-4bd72c322fac tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.314260 Aug 10 11:22:22.953455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 391/772] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:22 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:23.975608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:23.976188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:23.979294 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:23.984233 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:23.984719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:23.985146 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:23.985877 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:23.986322 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:23.986771 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:23.990034 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=83 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:24.127201 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:24.135315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:24.137061 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:24.138394 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7b1aafa2-7a49-43b7-ab11-46a93d481494 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.166551 Aug 10 11:22:24.139004 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 382/773] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:23 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:25.161185 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:25.161829 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:25.168895 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:25.169397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:25.169844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:25.170559 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:25.171042 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:25.171470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:25.177003 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:25.316645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:25.325437 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:25.326986 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:25.328158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5cbd8551-95f7-4920-a370-6b7d32d15694 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.170872 Aug 10 11:22:25.328702 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 392/774] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:25 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:25.619053 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5707241-2f21-46f6-a718-8aaad81de3fc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:25.621267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5707241-2f21-46f6-a718-8aaad81de3fc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:25.628222 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5707241-2f21-46f6-a718-8aaad81de3fc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:25.628719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5707241-2f21-46f6-a718-8aaad81de3fc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:25.629161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5707241-2f21-46f6-a718-8aaad81de3fc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:25.629866 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5707241-2f21-46f6-a718-8aaad81de3fc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:25.630329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5707241-2f21-46f6-a718-8aaad81de3fc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:25.630797 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5707241-2f21-46f6-a718-8aaad81de3fc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:25.660859 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5707241-2f21-46f6-a718-8aaad81de3fc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046763 Aug 10 11:22:25.661429 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 383/775] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:22:25 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:25.672962 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e694f08-be5c-42e7-87ad-0bc5ec50a8e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:25.673455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1e694f08-be5c-42e7-87ad-0bc5ec50a8e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:25.675732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=30 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:25.681099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e694f08-be5c-42e7-87ad-0bc5ec50a8e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:25.681577 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e694f08-be5c-42e7-87ad-0bc5ec50a8e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:25.682008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e694f08-be5c-42e7-87ad-0bc5ec50a8e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:25.682759 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e694f08-be5c-42e7-87ad-0bc5ec50a8e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:25.683371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e694f08-be5c-42e7-87ad-0bc5ec50a8e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:25.683800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e694f08-be5c-42e7-87ad-0bc5ec50a8e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:25.723943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1e694f08-be5c-42e7-87ad-0bc5ec50a8e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/41507c1d-1747-48e1-b9a8-4a667636cd92" status: 200 len: 194 microversion: 2.1 time: 0.054761 Aug 10 11:22:25.724525 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 393/776] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 10 11:22:25 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/41507c1d-1747-48e1-b9a8-4a667636cd92 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:26.351505 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:26.352030 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:26.358097 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:26.358595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:26.359049 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:26.360214 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:26.360214 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:26.360790 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:26.490020 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:26.497993 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:26.499553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:26.500735 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7ae56283-8a3b-442b-ac1d-93b0e5e219a1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.153202 Aug 10 11:22:26.501333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 384/777] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:26 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:27.074165 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6c925db4-7ef9-4626-8df1-11c546e280fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc4a6611-1943-41f3-bd95-f24467ca0e84"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:27.076612 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6c925db4-7ef9-4626-8df1-11c546e280fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:27.083009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c925db4-7ef9-4626-8df1-11c546e280fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:27.083491 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c925db4-7ef9-4626-8df1-11c546e280fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:27.083922 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c925db4-7ef9-4626-8df1-11c546e280fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:27.084606 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c925db4-7ef9-4626-8df1-11c546e280fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:27.085052 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c925db4-7ef9-4626-8df1-11c546e280fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:27.085468 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6c925db4-7ef9-4626-8df1-11c546e280fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:27.354036 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6c925db4-7ef9-4626-8df1-11c546e280fa tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "POST /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283859 Aug 10 11:22:27.354795 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 394/778] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:22:27 2022] POST /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:27.528882 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:27.528882 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:27.532561 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:27.533048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:27.533487 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:27.534174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:27.534651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:27.535083 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:27.668262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:27.676324 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:27.678027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:27.679206 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0303e6e6-2b3e-47b9-a792-74861cd884d0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.158269 Aug 10 11:22:27.679767 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 385/779] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:27 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:28.703217 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:28.703936 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:28.710033 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:28.710504 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:28.710964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:28.711642 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:28.712088 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:28.712871 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:28.850602 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:28.859606 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:28.861153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:28.862358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ed80e6fa-fb9a-4cec-a932-1773f7ee1ee7 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.163851 Aug 10 11:22:28.862944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 395/780] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:28 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:29.885604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:29.886240 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:29.893088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:29.893577 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:29.894016 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:29.894749 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:29.895206 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:29.895631 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:30.022314 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:30.030770 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:30.032296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:30.033426 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0ab8934b-38eb-40d9-813b-ad0063af87d8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.152228 Aug 10 11:22:30.033985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 386/781] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:29 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:31.056546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:31.057144 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:31.063531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:31.064007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:31.064435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:31.065117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:31.065562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:31.065981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:31.194849 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:31.203189 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:31.204675 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:31.205858 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a2ed8d99-2a72-4448-98b9-6b8f5d38c902 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.153246 Aug 10 11:22:31.206407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 396/782] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:31 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:32.229998 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:32.231908 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:32.236783 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:32.237265 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:32.237694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:32.238386 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:32.238857 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:32.239289 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:32.395172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:32.404112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:32.405634 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:32.406816 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-701e9a04-4bb8-4ed6-a7db-91ff9c222e46 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.181454 Aug 10 11:22:32.407476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 387/783] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:32 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:33.436337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:33.436943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:33.443520 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:33.444001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:33.444443 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:33.445166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:33.445620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:33.446043 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:33.583128 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:33.591936 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:33.593807 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:33.595035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b6540fc5-47e9-4fd9-a0f9-4b7a26dfaed6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1747 microversion: 2.20 time: 0.162692 Aug 10 11:22:33.595603 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 397/784] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:33 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1747 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:34.623225 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:34.624172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:34.631055 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:34.631538 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:34.631978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:34.632673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:34.633154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:34.633632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:34.771158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:34.782053 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:34.783605 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:34.784809 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f1cd631-aa54-4de2-b2ad-69cf58f347a2 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1747 microversion: 2.20 time: 0.169217 Aug 10 11:22:34.785474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 388/785] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:34 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1747 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:35.809344 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:35.810021 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:35.816527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:35.817007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:35.817449 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:35.818184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:35.818982 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:35.819142 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:35.966439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:35.975581 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:35.977073 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:35.978280 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cbe9f8dc-e220-45aa-a578-0bb65597a5a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1747 microversion: 2.20 time: 0.173329 Aug 10 11:22:35.979034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 398/786] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:35 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1747 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:35.982511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce8ecd83-df81-409c-ae99-19f8e45a1681 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:35.984659 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce8ecd83-df81-409c-ae99-19f8e45a1681 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:35.991423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce8ecd83-df81-409c-ae99-19f8e45a1681 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:35.991912 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce8ecd83-df81-409c-ae99-19f8e45a1681 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:35.992346 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce8ecd83-df81-409c-ae99-19f8e45a1681 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:35.993575 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce8ecd83-df81-409c-ae99-19f8e45a1681 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:35.994029 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce8ecd83-df81-409c-ae99-19f8e45a1681 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:35.994456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce8ecd83-df81-409c-ae99-19f8e45a1681 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:36.026868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce8ecd83-df81-409c-ae99-19f8e45a1681 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048132 Aug 10 11:22:36.027446 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 389/787] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:22:35 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:22:36.181919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ab044fb7-c451-4a14-ada1-283864c7a2e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:36.182324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ab044fb7-c451-4a14-ada1-283864c7a2e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:36.188679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab044fb7-c451-4a14-ada1-283864c7a2e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:36.189164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab044fb7-c451-4a14-ada1-283864c7a2e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:36.189597 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab044fb7-c451-4a14-ada1-283864c7a2e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:36.190301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab044fb7-c451-4a14-ada1-283864c7a2e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:36.190783 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab044fb7-c451-4a14-ada1-283864c7a2e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:36.191216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab044fb7-c451-4a14-ada1-283864c7a2e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:36.220418 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ab044fb7-c451-4a14-ada1-283864c7a2e9 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/41507c1d-1747-48e1-b9a8-4a667636cd92" status: 200 len: 194 microversion: 2.1 time: 0.043066 Aug 10 11:22:36.221007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 399/788] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 10 11:22:36 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/41507c1d-1747-48e1-b9a8-4a667636cd92 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:36.232002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:36.232502 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:36.239150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:36.239150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:36.239404 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:36.240101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:36.240556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:36.240985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:36.325056 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lazy-loading 'services' on Instance uuid 867eae69-3eb0-4d39-8851-02501b561bfe {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:22:36.400190 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-735c8832-a763-432d-9f72-2d83a33195e4 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "DELETE /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/41507c1d-1747-48e1-b9a8-4a667636cd92" status: 202 len: 0 microversion: 2.1 time: 0.172261 Aug 10 11:22:36.400815 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 390/789] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:22:36 2022] DELETE /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/41507c1d-1747-48e1-b9a8-4a667636cd92 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:22:36.970161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-7f770e35-5705-4cc1-b215-32c7d6dea1f8 req-1ffb063f-4b4d-4796-bcf4-30a413093855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00252e7d-b9e4-4476-a984-b33aa7286520", "name": "network-vif-plugged", "status": "completed", "tag": "70b8271c-1d70-4963-bf31-d732658386fc"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:36.982664 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-7f770e35-5705-4cc1-b215-32c7d6dea1f8 req-1ffb063f-4b4d-4796-bcf4-30a413093855 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:36.983155 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-7f770e35-5705-4cc1-b215-32c7d6dea1f8 req-1ffb063f-4b4d-4796-bcf4-30a413093855 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:36.983830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-7f770e35-5705-4cc1-b215-32c7d6dea1f8 req-1ffb063f-4b4d-4796-bcf4-30a413093855 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:36.995832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-7f770e35-5705-4cc1-b215-32c7d6dea1f8 req-1ffb063f-4b4d-4796-bcf4-30a413093855 service nova] Creating event network-vif-plugged:70b8271c-1d70-4963-bf31-d732658386fc for instance 00252e7d-b9e4-4476-a984-b33aa7286520 on hv-cinder-85272 Aug 10 11:22:37.001196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-7f770e35-5705-4cc1-b215-32c7d6dea1f8 req-1ffb063f-4b4d-4796-bcf4-30a413093855 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037131 Aug 10 11:22:37.002052 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 400/790] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:22:37.008188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:37.009925 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:37.021401 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:37.022333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:37.023812 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:37.025169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:37.025711 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:37.026076 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:37.165396 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:37.173422 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:37.174997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:37.176170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6e8a0535-6ac0-4a57-8811-cb8698352de0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1747 microversion: 2.20 time: 0.177763 Aug 10 11:22:37.176764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 391/791] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:36 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1747 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:38.201085 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:38.201786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:38.209178 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:38.209670 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:38.210105 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:38.210830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:38.211284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:38.211703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:38.349138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:38.358545 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:38.360343 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:38.361553 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bfacd09c-1450-453f-a9b8-4ad313969775 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1747 microversion: 2.20 time: 0.165942 Aug 10 11:22:38.362115 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 401/792] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:38 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1747 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:22:38.581993 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3afec66-0f5f-41d8-83be-b2ad745f1287 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:38.582624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3afec66-0f5f-41d8-83be-b2ad745f1287 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:38.589813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3afec66-0f5f-41d8-83be-b2ad745f1287 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:38.590315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3afec66-0f5f-41d8-83be-b2ad745f1287 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:38.590903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3afec66-0f5f-41d8-83be-b2ad745f1287 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:38.591596 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3afec66-0f5f-41d8-83be-b2ad745f1287 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:38.592055 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3afec66-0f5f-41d8-83be-b2ad745f1287 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:38.592483 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3afec66-0f5f-41d8-83be-b2ad745f1287 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:38.627430 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3afec66-0f5f-41d8-83be-b2ad745f1287 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/bc4a6611-1943-41f3-bd95-f24467ca0e84" status: 200 len: 194 microversion: 2.1 time: 0.049555 Aug 10 11:22:38.627945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 392/793] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 10 11:22:38 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/bc4a6611-1943-41f3-bd95-f24467ca0e84 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:38.639088 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:38.639576 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:38.645501 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:38.645983 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:38.646416 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:38.647143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:38.647674 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:38.648104 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:38.736686 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lazy-loading 'services' on Instance uuid 867eae69-3eb0-4d39-8851-02501b561bfe {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:22:38.819799 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-01ff2918-da57-47f3-a2b7-c72208f86f01 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "DELETE /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/bc4a6611-1943-41f3-bd95-f24467ca0e84" status: 202 len: 0 microversion: 2.1 time: 0.184363 Aug 10 11:22:38.820392 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 402/794] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:22:38 2022] DELETE /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments/bc4a6611-1943-41f3-bd95-f24467ca0e84 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:22:39.385963 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:39.386474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:39.395117 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:39.395813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:39.396331 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:39.397049 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:39.397502 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:39.397927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:39.558290 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:39.568013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:39.569691 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:39.571036 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-007675a5-f336-462a-b0a9-71fa6476bfd6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.189625 Aug 10 11:22:39.572396 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 393/795] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:39 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:40.598112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:40.599462 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:40.606564 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:40.607631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:40.607631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:40.608280 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:40.608774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:40.609208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:40.758808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:40.768533 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:40.770362 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:40.771631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0e7177a8-85f0-4b97-9b20-edd12bb3edf3 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.178235 Aug 10 11:22:40.772256 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 403/796] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:40 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:41.085327 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5b0702d-ab96-48dc-b0c8-243aba3f58dc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:41.088537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5b0702d-ab96-48dc-b0c8-243aba3f58dc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:41.096028 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b0702d-ab96-48dc-b0c8-243aba3f58dc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.100822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b0702d-ab96-48dc-b0c8-243aba3f58dc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.100822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b0702d-ab96-48dc-b0c8-243aba3f58dc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.100822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b0702d-ab96-48dc-b0c8-243aba3f58dc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.100822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b0702d-ab96-48dc-b0c8-243aba3f58dc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.101696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5b0702d-ab96-48dc-b0c8-243aba3f58dc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.132632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5b0702d-ab96-48dc-b0c8-243aba3f58dc tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051556 Aug 10 11:22:41.133322 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 394/797] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:22:41 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:22:41.269670 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-94b257e9-53b8-4d88-a67c-7e2d1a79d0f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:41.271997 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-94b257e9-53b8-4d88-a67c-7e2d1a79d0f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:41.278447 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94b257e9-53b8-4d88-a67c-7e2d1a79d0f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.279219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94b257e9-53b8-4d88-a67c-7e2d1a79d0f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.279652 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94b257e9-53b8-4d88-a67c-7e2d1a79d0f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.281202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94b257e9-53b8-4d88-a67c-7e2d1a79d0f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.281826 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94b257e9-53b8-4d88-a67c-7e2d1a79d0f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.282505 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-94b257e9-53b8-4d88-a67c-7e2d1a79d0f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.323730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-94b257e9-53b8-4d88-a67c-7e2d1a79d0f6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057940 Aug 10 11:22:41.325071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 404/798] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:22:41 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:22:41.405408 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:41.405956 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:41.413534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.414315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.415747 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.416736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.417488 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.418087 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.446467 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:22:41.559757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-97990832-dd60-4657-b0a6-20f6c3eedfa7 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "DELETE /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 204 len: 0 microversion: 2.1 time: 0.157702 Aug 10 11:22:41.561602 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 395/799] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:22:41 2022] DELETE /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:22:41.570536 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:41.572100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:41.597618 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.598117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.598551 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.603538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.605024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.606864 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.787151 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:41.797148 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:41.797848 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c9ef42d4-b465-48c5-9d02-e488487314c2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1674 microversion: 2.1 time: 0.231344 Aug 10 11:22:41.797984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:41.798727 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 405/800] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:41 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1674 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:22:41.812261 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.812261 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.812261 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.812261 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:41.812690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:41.812690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:41.834374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:41.976380 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:41.986444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:41.988003 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:41.989181 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96eccaf8-dcbf-43ad-beac-917ba9e4deb1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.196983 Aug 10 11:22:41.990293 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 396/801] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:41 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:22:42.821441 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:42.822370 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:42.830956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:42.831494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:42.831955 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:42.832880 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:42.833425 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:42.834123 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:42.991547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:43.002029 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1c58c8ee-2f66-47d5-a062-98eed4bddac6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1674 microversion: 2.1 time: 0.184214 Aug 10 11:22:43.014607 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 406/802] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:42 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:43.030621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:43.031918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:43.051139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:43.051701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:43.051911 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:43.052620 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:43.053066 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:43.053486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:43.207618 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:43.217023 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:43.218723 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:43.219911 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4b10b51-9162-4ab3-86d3-c1359dcc0959 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.208462 Aug 10 11:22:43.220479 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 397/803] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:43 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:44.032677 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:44.033925 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:44.040751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:44.041674 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:44.042339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:44.043513 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:44.044522 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:44.045586 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:44.070428 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:44.235847 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:44.246266 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:44.247224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cfd254a0-80cf-4817-bc3b-9ce97e689cf5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1674 microversion: 2.1 time: 0.218732 Aug 10 11:22:44.247379 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:44.248265 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 407/804] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:44 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:44.267544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:44.268168 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:44.269087 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:44.269356 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:44.269935 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:44.270529 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:44.481761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:44.499917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:44.501786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:44.503092 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e484c915-4416-4f60-86fb-1c921206919b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.261602 Aug 10 11:22:44.503847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 398/805] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:44 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:45.272416 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:45.273456 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:45.286837 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:45.287694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:45.288348 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:45.289309 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:45.289999 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:45.291582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:45.476464 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951cabf887f14896b0c4402b686be697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f397e080f497da06b661ea1a87e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:45.485302 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-60dad5cd-40e3-42a4-8ff7-83b737613464 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 200 len: 1607 microversion: 2.1 time: 0.219663 Aug 10 11:22:45.498189 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 408/806] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:45 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 1607 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:22:45.528137 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:45.528772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:45.539541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:45.542041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:45.542918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:45.544387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:45.546153 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:45.546153 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:45.760284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-dfc1e361-d093-4ec7-9782-7560b93362b4 req-47f85066-1c9c-4b63-bd2c-6f393919e5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "867eae69-3eb0-4d39-8851-02501b561bfe", "name": "network-vif-deleted", "tag": "c31171e3-d858-4518-a0f7-1da5d2d0ff09"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:45.776056 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-dfc1e361-d093-4ec7-9782-7560b93362b4 req-47f85066-1c9c-4b63-bd2c-6f393919e5d1 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:45.776837 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-dfc1e361-d093-4ec7-9782-7560b93362b4 req-47f85066-1c9c-4b63-bd2c-6f393919e5d1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:45.777451 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-dfc1e361-d093-4ec7-9782-7560b93362b4 req-47f85066-1c9c-4b63-bd2c-6f393919e5d1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:45.792941 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-dfc1e361-d093-4ec7-9782-7560b93362b4 req-47f85066-1c9c-4b63-bd2c-6f393919e5d1 service nova] Creating event network-vif-deleted:c31171e3-d858-4518-a0f7-1da5d2d0ff09 for instance 867eae69-3eb0-4d39-8851-02501b561bfe on hv-cinder-85272 Aug 10 11:22:45.797133 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:45.798671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-dfc1e361-d093-4ec7-9782-7560b93362b4 req-47f85066-1c9c-4b63-bd2c-6f393919e5d1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046665 Aug 10 11:22:45.799611 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 409/807] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:45.810890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:45.812429 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:45.813835 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-84cd179b-ae26-4e00-b525-ddb676a1b01b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.289865 Aug 10 11:22:45.814902 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 399/808] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:45 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:22:46.515680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:46.517367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:46.528672 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:46.529292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:46.529809 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:46.530714 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:46.533401 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:46.534348 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:46.552137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] HTTP exception thrown: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Request method failure captured: Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe HTTP/1.1 Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LJXyGVgk4g3BF3bMkM3zeA9lRX1mdmNSG2EOwCyfF4jJKpilCkulhY1NqNLBb2RW08AiPt5Ot7UKRjiWxZhysCkEA1SDBGd1OnmiMRGTkZP5tvpNh1RA9f8pwYJGcwC4IoFjWqGPxxU3St_kUKrCtq3-v7kzUl0DxdNCNnLWFIxPY Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:22:46.554526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c66f397e080f497da06b661ea1a87e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 951cabf887f14896b0c4402b686be697 Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:46.556706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '867eae69-3eb0-4d39-8851-02501b561bfe'} Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:46.557547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:46.561137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:46.563749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Returning 404 to user: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:46.563749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e272a146-a595-4346-b85b-a309366dc6a5 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 404 len: 111 microversion: 2.1 time: 0.046342 Aug 10 11:22:46.566745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 410/809] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:46 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:22:46.569313 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4a7d041d-c92e-4e0a-94e9-ad8a53031cf2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '.version_select at 0x7fccf8129310>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:46.654163 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4a7d041d-c92e-4e0a-94e9-ad8a53031cf2 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389543953" status: 202 len: 0 microversion: 2.1 time: 0.090058 Aug 10 11:22:46.656178 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 400/810] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 10 11:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389543953 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:22:46.844588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:46.850004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:46.871292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:46.872541 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:46.873153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:46.875007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:46.878801 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:46.878801 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:47.300260 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:47.311612 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:47.313139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:47.314599 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-135b454f-e1ee-412e-922d-97e616229c77 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.476948 Aug 10 11:22:47.315135 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 411/811] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:46 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:48.342226 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:48.342993 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:48.349948 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:48.350684 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:48.351201 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:48.351981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:48.352467 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:48.353449 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:48.503561 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:48.513918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:48.515761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:48.517174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2e3cc5fc-fe6d-4fb6-9b67-764f62371dda tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.179927 Aug 10 11:22:48.530888 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 401/812] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:48 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:49.542402 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:49.543043 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:49.552949 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:49.553802 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:49.554505 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:49.560595 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:49.561333 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:49.561866 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:49.731744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:49.740058 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:49.741570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:49.742775 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c2587b97-efd5-4075-ab22-6ac8b1bd5972 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.205401 Aug 10 11:22:49.758914 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 412/813] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:49 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:50.036772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:50.037878 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:50.045065 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:50.045828 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:50.046336 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:50.047315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:50.047777 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:50.048207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:50.064162 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] HTTP exception thrown: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Request method failure captured: Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe HTTP/1.1 Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LJXyGVgk4g3BF3bMkM3zeA9lRX1mdmNSG2EOwCyfF4jJKpilCkulhY1NqNLBb2RW08AiPt5Ot7UKRjiWxZhysCkEA1SDBGd1OnmiMRGTkZP5tvpNh1RA9f8pwYJGcwC4IoFjWqGPxxU3St_kUKrCtq3-v7kzUl0DxdNCNnLWFIxPY Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:22:50.065889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c66f397e080f497da06b661ea1a87e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 951cabf887f14896b0c4402b686be697 Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.067655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '867eae69-3eb0-4d39-8851-02501b561bfe'} Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:50.069499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.075015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.077107 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Returning 404 to user: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:50.077107 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-92ad9b12-6447-4eb8-a69e-d8bb30e8b28e tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "DELETE /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 404 len: 111 microversion: 2.1 time: 0.034704 Aug 10 11:22:50.077107 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 402/814] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:22:50 2022] DELETE /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:22:50.080083 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:50.080695 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: 867eae69-3eb0-4d39-8851-02501b561bfe] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:50.087756 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:50.088244 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:50.088682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:50.089376 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:50.090007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:50.090424 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:50.105496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] HTTP exception thrown: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Request method failure captured: Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe HTTP/1.1 Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LJXyGVgk4g3BF3bMkM3zeA9lRX1mdmNSG2EOwCyfF4jJKpilCkulhY1NqNLBb2RW08AiPt5Ot7UKRjiWxZhysCkEA1SDBGd1OnmiMRGTkZP5tvpNh1RA9f8pwYJGcwC4IoFjWqGPxxU3St_kUKrCtq3-v7kzUl0DxdNCNnLWFIxPY Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:22:50.107071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c66f397e080f497da06b661ea1a87e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 951cabf887f14896b0c4402b686be697 Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.109223 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '867eae69-3eb0-4d39-8851-02501b561bfe'} Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:50.109981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. Aug 10 11:22:50.111898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:50.114738 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Returning 404 to user: Instance 867eae69-3eb0-4d39-8851-02501b561bfe could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:50.114738 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d41c81db-e4c8-49b0-b389-ca45ae8eda08 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe" status: 404 len: 111 microversion: 2.1 time: 0.033642 Aug 10 11:22:50.114738 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 413/815] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:50 2022] GET /compute/v2.1/servers/867eae69-3eb0-4d39-8851-02501b561bfe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:22:50.766543 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:50.767981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:50.777340 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:50.778816 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:50.779397 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:50.780041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:50.780501 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:50.780931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:50.934083 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:50.942357 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:50.944158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:50.945626 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-305b4b39-0a4c-44cf-8633-bf0a198a5878 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1742 microversion: 2.20 time: 0.183605 Aug 10 11:22:50.959050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 403/816] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:50 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:51.272095 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:51.272595 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:51.279661 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.280081 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.280536 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:51.281199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.281676 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.282114 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:51.295836 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] HTTP exception thrown: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Request method failure captured: Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 HTTP/1.1 Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LJXyGVgk4g3BF3bMkM3zeA9lRX1mdmNSG2EOwCyfF4jJKpilCkulhY1NqNLBb2RW08AiPt5Ot7UKRjiWxZhysCkEA1SDBGd1OnmiMRGTkZP5tvpNh1RA9f8pwYJGcwC4IoFjWqGPxxU3St_kUKrCtq3-v7kzUl0DxdNCNnLWFIxPY Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:22:51.297307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c66f397e080f497da06b661ea1a87e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 951cabf887f14896b0c4402b686be697 Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.298960 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': 'b5d74ab5-9978-4af6-9fff-34b86d739057'} Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:51.299984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.301435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.302901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Returning 404 to user: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:51.302901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d7c78d45-8ac5-482c-a4df-7657baec7fe6 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 404 len: 111 microversion: 2.1 time: 0.030392 Aug 10 11:22:51.302901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 414/817] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:22:51 2022] DELETE /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:22:51.308228 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:51.308844 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] [instance: b5d74ab5-9978-4af6-9fff-34b86d739057] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:51.315317 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.315804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.316240 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:51.316940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.317400 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.317832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:51.331831 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] HTTP exception thrown: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Request method failure captured: Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 HTTP/1.1 Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LJXyGVgk4g3BF3bMkM3zeA9lRX1mdmNSG2EOwCyfF4jJKpilCkulhY1NqNLBb2RW08AiPt5Ot7UKRjiWxZhysCkEA1SDBGd1OnmiMRGTkZP5tvpNh1RA9f8pwYJGcwC4IoFjWqGPxxU3St_kUKrCtq3-v7kzUl0DxdNCNnLWFIxPY Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:22:51.333344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c66f397e080f497da06b661ea1a87e03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c66f397e080f497da06b661ea1a87e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: c66f397e080f497da06b661ea1a87e03 Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222939927 Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 951cabf887f14896b0c4402b686be697 Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-222939927-project Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.334982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': 'b5d74ab5-9978-4af6-9fff-34b86d739057'} Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:51.335822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. Aug 10 11:22:51.337751 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:22:51.338899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] Returning 404 to user: Instance b5d74ab5-9978-4af6-9fff-34b86d739057 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:51.338899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a5aadeb-1dc1-4943-b0c1-66e458af7c65 tempest-AttachVolumeTestJSON-222939927 tempest-AttachVolumeTestJSON-222939927-project] 10.222.0.49 "GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057" status: 404 len: 111 microversion: 2.1 time: 0.030357 Aug 10 11:22:51.338899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 404/818] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:51 2022] GET /compute/v2.1/servers/b5d74ab5-9978-4af6-9fff-34b86d739057 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:22:51.973539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:51.974295 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:51.981136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.981680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.982237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:51.983026 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.983609 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.984103 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:52.327710 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:52.337701 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:52.339543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:52.340811 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2a7faefb-ffa2-4baf-aeda-da18174d679a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1724 microversion: 2.20 time: 0.372181 Aug 10 11:22:52.354597 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 415/819] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:51 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1724 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:53.365005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:53.365811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:53.372892 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:53.373414 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:53.373846 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:53.374547 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:53.375123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:53.375491 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:53.623879 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:53.632547 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:53.634857 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:53.636302 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-296addc9-4b9f-47ba-9eeb-327f7013acb5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1724 microversion: 2.20 time: 0.275205 Aug 10 11:22:53.636999 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 405/820] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:53 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:54.578073 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9d2ce713-a038-46d1-8c4b-8ddfeba5019f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:54.578607 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9d2ce713-a038-46d1-8c4b-8ddfeba5019f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:54.586321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d2ce713-a038-46d1-8c4b-8ddfeba5019f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:54.588214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d2ce713-a038-46d1-8c4b-8ddfeba5019f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:54.588866 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d2ce713-a038-46d1-8c4b-8ddfeba5019f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:54.589773 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d2ce713-a038-46d1-8c4b-8ddfeba5019f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:54.590430 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d2ce713-a038-46d1-8c4b-8ddfeba5019f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:54.591072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d2ce713-a038-46d1-8c4b-8ddfeba5019f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:54.617355 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9d2ce713-a038-46d1-8c4b-8ddfeba5019f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/ips" status: 200 len: 150 microversion: 2.1 time: 0.043329 Aug 10 11:22:54.624257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 416/821] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:22:54 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:54.661715 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:54.662334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:54.673820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:54.676538 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:54.677768 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:54.678217 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:54.679094 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:54.681694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:54.682545 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:54.961168 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:54.979399 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:54.982396 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:54.996683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2ec04c3-adcc-4455-9488-5d773d666a1b tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1724 microversion: 2.20 time: 0.338901 Aug 10 11:22:54.998077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 406/822] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:54 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:55.151767 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5b01e508-8800-41a9-97c5-bcf4628bd501 req-5c62af2d-a1a5-442c-acd3-52cc3782c086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00252e7d-b9e4-4476-a984-b33aa7286520", "name": "network-vif-unplugged", "status": "completed", "tag": "70b8271c-1d70-4963-bf31-d732658386fc"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:55.162835 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5b01e508-8800-41a9-97c5-bcf4628bd501 req-5c62af2d-a1a5-442c-acd3-52cc3782c086 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:55.163629 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5b01e508-8800-41a9-97c5-bcf4628bd501 req-5c62af2d-a1a5-442c-acd3-52cc3782c086 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:55.164242 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5b01e508-8800-41a9-97c5-bcf4628bd501 req-5c62af2d-a1a5-442c-acd3-52cc3782c086 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:55.176797 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5b01e508-8800-41a9-97c5-bcf4628bd501 req-5c62af2d-a1a5-442c-acd3-52cc3782c086 service nova] Creating event network-vif-unplugged:70b8271c-1d70-4963-bf31-d732658386fc for instance 00252e7d-b9e4-4476-a984-b33aa7286520 on hv-cinder-85272 Aug 10 11:22:55.182557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5b01e508-8800-41a9-97c5-bcf4628bd501 req-5c62af2d-a1a5-442c-acd3-52cc3782c086 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035683 Aug 10 11:22:55.183470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 417/823] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:22:56.027194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:56.028817 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:56.040713 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:56.041321 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:56.042586 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:56.044017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:56.045054 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:56.045901 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:56.173394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0e47a81c-bffb-4964-8429-0bc75323959a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "477284e8-7d84-4d1a-b8a0-783ab5630988"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:56.176403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0e47a81c-bffb-4964-8429-0bc75323959a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:56.178728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=50 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:56.185552 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e47a81c-bffb-4964-8429-0bc75323959a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:56.186131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e47a81c-bffb-4964-8429-0bc75323959a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:56.186888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e47a81c-bffb-4964-8429-0bc75323959a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:56.187721 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e47a81c-bffb-4964-8429-0bc75323959a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:56.188452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e47a81c-bffb-4964-8429-0bc75323959a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:56.189169 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e47a81c-bffb-4964-8429-0bc75323959a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:56.395888 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:56.406250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:56.407783 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:56.409183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1d67e5c-ea18-422e-8ab3-08cbe11f3c07 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1667 microversion: 2.20 time: 0.388036 Aug 10 11:22:56.410373 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 407/824] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:56 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1667 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:56.439283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f24cf16-f1e7-482e-b792-651a2ea2a755 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77b8d766-729f-4834-8acd-0043fd9573a7"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:56.442618 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f24cf16-f1e7-482e-b792-651a2ea2a755 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:56.450080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f24cf16-f1e7-482e-b792-651a2ea2a755 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:56.450558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f24cf16-f1e7-482e-b792-651a2ea2a755 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:56.451210 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f24cf16-f1e7-482e-b792-651a2ea2a755 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:56.451916 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f24cf16-f1e7-482e-b792-651a2ea2a755 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:56.452366 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f24cf16-f1e7-482e-b792-651a2ea2a755 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:56.452791 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f24cf16-f1e7-482e-b792-651a2ea2a755 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:56.838993 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0e47a81c-bffb-4964-8429-0bc75323959a tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "POST /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671640 Aug 10 11:22:56.839905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 418/825] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:22:56 2022] POST /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments => generated 194 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:22:56.859854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f24cf16-f1e7-482e-b792-651a2ea2a755 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.427444 Aug 10 11:22:56.867098 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 408/826] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 10 11:22:56 2022] POST /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/os-volume_attachments => generated 188 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:22:57.039815 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9a7f15a2-85df-4a1a-9263-83c8e532c492 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:57.040434 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9a7f15a2-85df-4a1a-9263-83c8e532c492 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:57.047051 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a7f15a2-85df-4a1a-9263-83c8e532c492 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:57.050678 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a7f15a2-85df-4a1a-9263-83c8e532c492 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:57.050678 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a7f15a2-85df-4a1a-9263-83c8e532c492 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:57.050678 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a7f15a2-85df-4a1a-9263-83c8e532c492 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:57.050678 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a7f15a2-85df-4a1a-9263-83c8e532c492 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:57.051590 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a7f15a2-85df-4a1a-9263-83c8e532c492 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:57.332588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9a7f15a2-85df-4a1a-9263-83c8e532c492 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/os-volume_attachments/77b8d766-729f-4834-8acd-0043fd9573a7" status: 202 len: 0 microversion: 2.20 time: 0.296965 Aug 10 11:22:57.333382 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 419/827] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 10 11:22:57 2022] DELETE /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/os-volume_attachments/77b8d766-729f-4834-8acd-0043fd9573a7 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:22:57.379148 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e6cb1a22-6f8f-47e4-bcf6-6d41078e8768 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Action: 'create', calling method: .version_select at 0x7fccf2f2bb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1923432899"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:57.396887 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:57.397444 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:57.404497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:57.405326 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:57.406226 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:57.406559 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:57.407022 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:57.407543 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:57.458116 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117919) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 11:22:57.544428 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-208c0552-4103-4cfd-a7f5-6a3b8a3bcc8a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "POST /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/action" status: 202 len: 0 microversion: 2.20 time: 0.151286 Aug 10 11:22:57.545722 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 420/828] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 10 11:22:57 2022] POST /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:22:57.559565 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:57.561198 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:57.570791 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:57.571611 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:57.571781 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:57.572850 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:57.573320 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:57.573775 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:57.759216 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e6cb1a22-6f8f-47e4-bcf6-6d41078e8768 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.510986 Aug 10 11:22:57.759967 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 409/829] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Aug 10 11:22:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 513 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 11:22:57.780959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13a0d49c-1776-4e11-a916-c955eab84595 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf8050c10>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:57.817733 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:57.828999 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:57.830560 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:57.831806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e92c2896-262d-4c1e-bacd-e381e545e69d tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1675 microversion: 2.20 time: 0.279632 Aug 10 11:22:57.832899 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 421/830] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:57 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1675 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:22:57.849619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13a0d49c-1776-4e11-a916-c955eab84595 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e" status: 200 len: 345 microversion: 2.1 time: 0.073255 Aug 10 11:22:57.852188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 410/831] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:57 2022] GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:58.860058 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:58.860735 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:58.868990 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:58.869742 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:58.870364 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:58.871029 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1be7b27d-87bc-4eaa-8629-6c26c3298d96 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf2ee1b80>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:58.871975 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:58.871975 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:58.872238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:58.931228 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1be7b27d-87bc-4eaa-8629-6c26c3298d96 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e" status: 200 len: 346 microversion: 2.1 time: 0.066752 Aug 10 11:22:58.940929 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 411/832] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:58 2022] GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:58.948838 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6bd3d100-bb28-488b-a9f0-e85886a9e862 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Action: 'create', calling method: .version_select at 0x7fccf2ee61f0>, body: {"snapshot": {"volume_id": "0d82857e-c3d2-4499-8b92-aa856fa2df6e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2112866551"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:59.108816 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:59.117744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:59.119631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:59.121081 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0847f3b4-15e0-46a8-b2ac-bc1fbb8bec31 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.265599 Aug 10 11:22:59.122360 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 422/833] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:22:58 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:22:59.161473 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6bd3d100-bb28-488b-a9f0-e85886a9e862 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.219129 Aug 10 11:22:59.162704 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 412/834] 10.222.0.49 () {60 vars in 1162 bytes} [Wed Aug 10 11:22:58 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:59.175800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-829ae177-412f-4cd9-8ec1-660a132dcefa tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf37408b0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:59.210998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-829ae177-412f-4cd9-8ec1-660a132dcefa tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 200 len: 287 microversion: 2.1 time: 0.040044 Aug 10 11:22:59.212458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 423/835] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:59 2022] GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:59.223698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09dc17fe-dae1-4568-a0bb-9832762e7c3d tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf2ee6d30>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:59.256096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-09dc17fe-dae1-4568-a0bb-9832762e7c3d tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036224 Aug 10 11:22:59.256786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 413/836] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 10 11:22:59 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:59.268572 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-34ce5ef3-7c5d-4fc8-b50f-4022317a4eb0 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf80ae9d0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:59.299995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-34ce5ef3-7c5d-4fc8-b50f-4022317a4eb0 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 200 len: 287 microversion: 2.1 time: 0.035840 Aug 10 11:22:59.301481 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 424/837] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:59 2022] GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:00.147395 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:00.148136 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:00.156038 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:00.156561 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:00.157068 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:00.157716 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:00.158182 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:00.158632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:00.294316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:00.302788 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:00.304306 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:00.305464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4bcd4208-720a-476c-b431-2eeba5c5bc1c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.163644 Aug 10 11:23:00.306028 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 414/838] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:00 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:00.315625 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-712fd408-a7f1-431c-becb-066e35803671 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf372b940>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:00.348556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-712fd408-a7f1-431c-becb-066e35803671 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 200 len: 287 microversion: 2.1 time: 0.037714 Aug 10 11:23:00.349414 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 425/839] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 11:23:00 2022] GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:01.329200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:01.329886 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:01.335976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:01.336456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:01.336890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:01.337621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:01.338078 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:01.338498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:01.361911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-66376a4c-35f4-4d45-b07c-403d4476c440 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf3740ca0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:01.396508 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-66376a4c-35f4-4d45-b07c-403d4476c440 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 200 len: 287 microversion: 2.1 time: 0.038903 Aug 10 11:23:01.397075 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 426/840] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 11:23:01 2022] GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:23:01.474306 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:01.483106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:01.484642 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:01.485836 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-45114ca1-5849-4231-8be8-f8adb30dcebe tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.161317 Aug 10 11:23:01.486420 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 415/841] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:01 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:02.410132 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-abb329fe-9db6-4ce2-b98d-86309bba2b38 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf377a1f0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:02.445299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-abb329fe-9db6-4ce2-b98d-86309bba2b38 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 200 len: 287 microversion: 2.1 time: 0.039352 Aug 10 11:23:02.445991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 427/842] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 11:23:02 2022] GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:02.508815 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:02.509943 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:02.516424 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:02.516916 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:02.517356 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:02.518066 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:02.518531 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:02.518993 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:02.806873 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.814859 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.816372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.817524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8bcb17b-ece5-4356-8a49-d75820771304 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.312713 Aug 10 11:23:02.818084 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 416/843] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:02 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:03.459887 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-30f4aba5-1dbe-4c0b-9f22-88c7fd647a91 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf80649d0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:03.491274 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-30f4aba5-1dbe-4c0b-9f22-88c7fd647a91 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 200 len: 287 microversion: 2.1 time: 0.035410 Aug 10 11:23:03.491465 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 428/844] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 11:23:03 2022] GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:23:03.840251 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:03.841052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:03.847508 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.848005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.848448 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.849172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.849631 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.850056 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.998205 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.000409 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:04.008199 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.010250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.011436 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dfd20ff4-f71c-41c5-90e9-6bfe6636ea72 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.175267 Aug 10 11:23:04.011985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 417/845] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:03 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:04.507328 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f9fb9fef-6cf5-4efd-9c02-43a7da1a1ccc tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf37409d0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:04.538641 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f9fb9fef-6cf5-4efd-9c02-43a7da1a1ccc tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 200 len: 288 microversion: 2.1 time: 0.038071 Aug 10 11:23:04.539208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 429/846] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 11:23:04 2022] GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:04.550207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d849a378-d0c7-46af-837a-777d5ff4a797 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf2f7b9d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:04.622109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d849a378-d0c7-46af-837a-777d5ff4a797 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 202 len: 0 microversion: 2.1 time: 0.075317 Aug 10 11:23:04.623006 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 418/847] 10.222.0.49 () {58 vars in 1254 bytes} [Wed Aug 10 11:23:04 2022] DELETE /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:23:04.632266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-527ee971-c589-45f8-ac03-a344e5cbe096 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf3740af0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:04.676245 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-527ee971-c589-45f8-ac03-a344e5cbe096 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 200 len: 287 microversion: 2.1 time: 0.048198 Aug 10 11:23:04.677316 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 430/848] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 11:23:04 2022] GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:05.035046 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:05.035708 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:05.041846 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.042372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.042880 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.043654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.044184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.044645 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.217795 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.229609 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.231196 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.232541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7177e21a-e00b-4f64-a0a4-173362227265 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.201857 Aug 10 11:23:05.234613 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 419/849] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:05 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:05.698808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b8ae1de-f185-41d0-8c5d-bdf56133f301 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf8064b80>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:05.726243 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-7b8ae1de-f185-41d0-8c5d-bdf56133f301 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] HTTP exception thrown: Snapshot 45b7fc88-780a-42cc-987c-8eb75d1217ca could not be found. Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b8ae1de-f185-41d0-8c5d-bdf56133f301 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Request method failure captured: Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca HTTP/1.1 Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85URD5qmSSY1EAwQpUpewPgBiMkfcyKhXsb1lYqlvMJoVurMaTraDjtQD5PJrDVwUyFQAXjz32LKh8l_FpYY_nFY5qJZJfO4qTm773n5PoKvGAhyvCTnMSszHMZlheXJ01VucdBVVCtUgFEP5jJJJ9fr6DAo63ak0iZHRNRTN6w5Xr8 Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 92fa9dd2388b485195253752f4afa47f Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:23:05.729557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92fa9dd2388b485195253752f4afa47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 92fa9dd2388b485195253752f4afa47f Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotsTestJSON-1494580553-project Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 382570a5f51d4f29ae4faff617a144d3 Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1494580553-project Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Snapshot 45b7fc88-780a-42cc-987c-8eb75d1217ca could not be found. Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '45b7fc88-780a-42cc-987c-8eb75d1217ca'} Aug 10 11:23:05.731203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 45b7fc88-780a-42cc-987c-8eb75d1217ca could not be found. (HTTP 404) (Request-ID: req-006a9b54-ab83-40e4-b5c5-8a7439e4eacb) Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:05.732496 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:05.733859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 45b7fc88-780a-42cc-987c-8eb75d1217ca could not be found. Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 11:23:05.735386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 45b7fc88-780a-42cc-987c-8eb75d1217ca could not be found. Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 45b7fc88-780a-42cc-987c-8eb75d1217ca could not be found. Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b8ae1de-f185-41d0-8c5d-bdf56133f301 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Returning 404 to user: Snapshot 45b7fc88-780a-42cc-987c-8eb75d1217ca could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:05.736944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b8ae1de-f185-41d0-8c5d-bdf56133f301 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca" status: 404 len: 111 microversion: 2.1 time: 0.043664 Aug 10 11:23:05.737953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 431/850] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 11:23:05 2022] GET /compute/v2.1/os-snapshots/45b7fc88-780a-42cc-987c-8eb75d1217ca => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:05.740036 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6352491e-8d75-450e-a094-7bf36c739926 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf2f081f0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:05.807664 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6352491e-8d75-450e-a094-7bf36c739926 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e" status: 202 len: 0 microversion: 2.1 time: 0.071169 Aug 10 11:23:05.808217 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 420/851] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:23:05 2022] DELETE /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:23:05.826433 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4f78cefe-990b-42df-be51-b19fb83243b8 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf8064ee0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:05.881647 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4f78cefe-990b-42df-be51-b19fb83243b8 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e" status: 200 len: 345 microversion: 2.1 time: 0.059791 Aug 10 11:23:05.882253 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 432/852] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:05 2022] GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:06.260071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:06.260793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:06.267245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.267622 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.268147 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.269170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.269641 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.270166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.433025 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:06.441484 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:06.443096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:06.444266 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5c862a83-e4fb-491b-a355-22bae58cffed tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.190157 Aug 10 11:23:06.444821 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 421/853] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:06 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:06.898182 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-46a9e702-8f08-4ce6-b01f-3a4c0df4a8e9 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf802e550>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:06.926734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-46a9e702-8f08-4ce6-b01f-3a4c0df4a8e9 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] HTTP exception thrown: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-46a9e702-8f08-4ce6-b01f-3a4c0df4a8e9 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Request method failure captured: Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e HTTP/1.1 Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85URD5qmSSY1EAwQpUpewPgBiMkfcyKhXsb1lYqlvMJoVurMaTraDjtQD5PJrDVwUyFQAXjz32LKh8l_FpYY_nFY5qJZJfO4qTm773n5PoKvGAhyvCTnMSszHMZlheXJ01VucdBVVCtUgFEP5jJJJ9fr6DAo63ak0iZHRNRTN6w5Xr8 Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 92fa9dd2388b485195253752f4afa47f Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:23:06.929007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92fa9dd2388b485195253752f4afa47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 92fa9dd2388b485195253752f4afa47f Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotsTestJSON-1494580553-project Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 382570a5f51d4f29ae4faff617a144d3 Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1494580553-project Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '0d82857e-c3d2-4499-8b92-aa856fa2df6e'} Aug 10 11:23:06.930604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. (HTTP 404) (Request-ID: req-e136c114-44f7-4998-8b11-3729ea3dfa0c) Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:06.931991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:06.933972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:23:06.936680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-46a9e702-8f08-4ce6-b01f-3a4c0df4a8e9 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Returning 404 to user: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-46a9e702-8f08-4ce6-b01f-3a4c0df4a8e9 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e" status: 404 len: 109 microversion: 2.1 time: 0.036777 Aug 10 11:23:06.939032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 433/854] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:06 2022] GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:06.948155 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84ea020b-239b-4cb6-a3f4-b46ff9ac43f1 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf2f08040>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:06.977390 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-84ea020b-239b-4cb6-a3f4-b46ff9ac43f1 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] HTTP exception thrown: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84ea020b-239b-4cb6-a3f4-b46ff9ac43f1 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Request method failure captured: Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e HTTP/1.1 Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85URD5qmSSY1EAwQpUpewPgBiMkfcyKhXsb1lYqlvMJoVurMaTraDjtQD5PJrDVwUyFQAXjz32LKh8l_FpYY_nFY5qJZJfO4qTm773n5PoKvGAhyvCTnMSszHMZlheXJ01VucdBVVCtUgFEP5jJJJ9fr6DAo63ak0iZHRNRTN6w5Xr8 Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 92fa9dd2388b485195253752f4afa47f Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:23:06.980977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92fa9dd2388b485195253752f4afa47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 92fa9dd2388b485195253752f4afa47f Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotsTestJSON-1494580553-project Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 382570a5f51d4f29ae4faff617a144d3 Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1494580553-project Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '0d82857e-c3d2-4499-8b92-aa856fa2df6e'} Aug 10 11:23:06.983745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. (HTTP 404) (Request-ID: req-7a66597a-6f6e-4af0-859c-c0bf123d8d44) Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:06.985347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:23:06.988074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 11:23:06.990606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84ea020b-239b-4cb6-a3f4-b46ff9ac43f1 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Returning 404 to user: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-84ea020b-239b-4cb6-a3f4-b46ff9ac43f1 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e" status: 404 len: 109 microversion: 2.1 time: 0.039061 Aug 10 11:23:06.992628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 422/855] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:23:06 2022] DELETE /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:06.994528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6a1c2c11-d60a-4a27-bca0-f650bb110e34 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Calling method '.version_select at 0x7fccf8064a60>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:07.021844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-6a1c2c11-d60a-4a27-bca0-f650bb110e34 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] HTTP exception thrown: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6a1c2c11-d60a-4a27-bca0-f650bb110e34 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Request method failure captured: Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e HTTP/1.1 Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85URD5qmSSY1EAwQpUpewPgBiMkfcyKhXsb1lYqlvMJoVurMaTraDjtQD5PJrDVwUyFQAXjz32LKh8l_FpYY_nFY5qJZJfO4qTm773n5PoKvGAhyvCTnMSszHMZlheXJ01VucdBVVCtUgFEP5jJJJ9fr6DAo63ak0iZHRNRTN6w5Xr8 Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 92fa9dd2388b485195253752f4afa47f Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:23:07.023804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fa9dd2388b485195253752f4afa47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92fa9dd2388b485195253752f4afa47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 92fa9dd2388b485195253752f4afa47f Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1494580553 Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotsTestJSON-1494580553-project Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 382570a5f51d4f29ae4faff617a144d3 Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1494580553-project Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '0d82857e-c3d2-4499-8b92-aa856fa2df6e'} Aug 10 11:23:07.025479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. (HTTP 404) (Request-ID: req-a7e5e49a-ea65-4ef8-8365-82a0504a45bf) Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:07.026494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:07.027905 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:23:07.029374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6a1c2c11-d60a-4a27-bca0-f650bb110e34 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] Returning 404 to user: Volume 0d82857e-c3d2-4499-8b92-aa856fa2df6e could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6a1c2c11-d60a-4a27-bca0-f650bb110e34 tempest-VolumesSnapshotsTestJSON-1494580553 tempest-VolumesSnapshotsTestJSON-1494580553-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e" status: 404 len: 109 microversion: 2.1 time: 0.037736 Aug 10 11:23:07.030956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 434/856] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:06 2022] GET /compute/v2.1/os-volumes/0d82857e-c3d2-4499-8b92-aa856fa2df6e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:23:07.468071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:07.468734 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:07.475987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:07.476492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:07.476936 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:07.477720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:07.478149 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:07.478609 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:07.732800 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:07.741241 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:07.742793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:07.744492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f6650d2b-413e-4220-b728-5d065571ec8f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.280823 Aug 10 11:23:07.745046 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 423/857] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:07 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:08.768712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:08.769326 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:08.776533 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:08.777029 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:08.777659 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:08.778419 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:08.779104 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:08.779588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:08.809171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:08.958615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:08.967822 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:08.969358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:08.970906 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-320af1af-2f06-41d1-b599-56b0f0f2acf4 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.206715 Aug 10 11:23:08.971941 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 435/858] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:08 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:09.996305 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:09.996919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:10.003388 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.003875 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.004313 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.005023 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.005475 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.005897 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.156743 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:10.167664 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:10.169955 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:10.171689 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb89d6e7-f59f-4199-bb08-a49fc0be75da tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.179675 Aug 10 11:23:10.173032 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 424/859] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:09 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:11.194776 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:11.195393 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:11.208742 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.210137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.210595 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.211329 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.216469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.228892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.450253 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:11.458917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:11.460812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:11.462036 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6f5f87d0-5048-48ec-b7cb-e6fefe55f830 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.271226 Aug 10 11:23:11.462631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 436/860] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:11 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:12.496247 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:12.497538 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:12.505561 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:12.506487 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:12.507112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:12.508006 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:12.509646 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:12.510253 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:12.694448 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:12.707341 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:12.709914 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:12.716403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-84e18c9c-de37-4925-94c7-b20706daca1a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.224945 Aug 10 11:23:12.717101 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 425/861] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:12 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:13.740697 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:13.741322 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:13.748447 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.749096 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.749351 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.750038 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.750488 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.750935 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.936027 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.943947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.945458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.947265 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-90ccebaf-8c0d-42c7-ba77-94950bcc8dbd tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.209901 Aug 10 11:23:13.947869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 437/862] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:13 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:14.972547 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:14.973333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:14.980015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.980505 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.980963 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:14.981647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.982108 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.982533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:15.115640 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:15.124189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:15.125719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:15.126937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be74cbaf-57e3-4c54-833f-4a266fd83aa8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.158301 Aug 10 11:23:15.127497 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 426/863] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:14 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:16.150654 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:16.151389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:16.160872 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:16.161645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:16.162087 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:16.162862 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:16.163312 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:16.163738 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:16.304192 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:16.313364 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:16.314907 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:16.316168 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-431d740f-c2b1-432f-b7b3-a6f3a5fc7fe6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.170007 Aug 10 11:23:16.316946 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 438/864] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:16 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:17.343887 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:17.344495 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:17.351311 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:17.351803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:17.352242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.352961 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:17.353430 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:17.353868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.488984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.497659 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.499606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.500788 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5763ae7d-e7c1-43cb-971c-17817bcac895 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.160857 Aug 10 11:23:17.501343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 427/865] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:17 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:18.524202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:18.525437 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:18.532571 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.537383 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.538143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.539456 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.551438 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.552520 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.715986 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.724489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.725983 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.727184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7713a289-6b0e-4715-afe4-b7d6b739fc6c tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.206934 Aug 10 11:23:18.727748 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 439/866] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:18 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:19.749978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:19.750620 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:19.757231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.757723 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.758162 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.758898 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.759852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.760282 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.893366 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:19.902047 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:19.903604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:19.904771 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3699be1-ec75-4fd3-94bf-9a1ef57244e5 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.158784 Aug 10 11:23:19.905327 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 428/867] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:19 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:20.927943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:20.928594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:20.936092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:20.936590 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:20.937035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:20.937754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:20.938212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:20.938669 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.092427 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:21.101639 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:21.103604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:21.105002 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7abf1bbe-5e32-4970-b7f7-7f50ba929340 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.180928 Aug 10 11:23:21.105595 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 440/868] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:20 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:22.130931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:22.131474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:22.138385 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.139106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.139573 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:22.140318 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.140872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.141404 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:22.279561 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:22.288116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:22.289631 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:22.290893 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8003c3ba-b8bc-4481-a866-8e996f9381de tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.163935 Aug 10 11:23:22.291463 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 429/869] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:22 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:23.313369 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:23.313912 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:23.321366 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:23.321908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:23.322339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:23.323075 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:23.323788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:23.324207 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:23.487716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:23.497470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:23.499035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:23.500194 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-de3039f5-3a47-47eb-a303-289a4bad4517 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.190869 Aug 10 11:23:23.500748 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 441/870] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:23 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:24.525608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:24.526227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:24.533188 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.533678 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.534111 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.534849 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.535300 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.535724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.760350 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:24.776026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:24.779142 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:24.781092 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5705fa15-d9a3-4a7c-b6f2-62552b606484 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.259840 Aug 10 11:23:24.782203 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 430/871] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:24 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:24.906970 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:24.907785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:24.916358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.917093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.917636 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.918537 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.919126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.919676 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.007952 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lazy-loading 'services' on Instance uuid 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:23:25.112209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e5449874-37a1-4ec6-b97d-16ccb8491af5 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments/477284e8-7d84-4d1a-b8a0-783ab5630988" status: 202 len: 0 microversion: 2.1 time: 0.212687 Aug 10 11:23:25.113210 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 442/872] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:23:24 2022] DELETE /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments/477284e8-7d84-4d1a-b8a0-783ab5630988 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:23:25.121813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb77e988-9464-4f72-9cab-61f573d58e77 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:25.124172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb77e988-9464-4f72-9cab-61f573d58e77 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:25.127105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=34 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:25.132296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb77e988-9464-4f72-9cab-61f573d58e77 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.132792 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb77e988-9464-4f72-9cab-61f573d58e77 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.133224 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb77e988-9464-4f72-9cab-61f573d58e77 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.133923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb77e988-9464-4f72-9cab-61f573d58e77 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.134926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb77e988-9464-4f72-9cab-61f573d58e77 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.135643 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb77e988-9464-4f72-9cab-61f573d58e77 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.166599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb77e988-9464-4f72-9cab-61f573d58e77 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048582 Aug 10 11:23:25.167089 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 431/873] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:23:25 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:23:25.812282 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:25.812994 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:25.830612 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.831099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.831783 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.832502 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.833101 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.833523 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.981187 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:25.989409 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:25.990959 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:25.992175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-00d113d6-d0ad-4c17-bc91-9382d803c7f9 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.184241 Aug 10 11:23:25.992798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 443/874] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:25 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:26.179314 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4bfe8efa-95e9-40b0-a505-cbf763d4d7bd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:26.182014 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4bfe8efa-95e9-40b0-a505-cbf763d4d7bd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:26.189898 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bfe8efa-95e9-40b0-a505-cbf763d4d7bd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:26.190489 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bfe8efa-95e9-40b0-a505-cbf763d4d7bd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:26.191032 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bfe8efa-95e9-40b0-a505-cbf763d4d7bd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:26.191824 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bfe8efa-95e9-40b0-a505-cbf763d4d7bd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:26.192331 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bfe8efa-95e9-40b0-a505-cbf763d4d7bd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:26.192823 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4bfe8efa-95e9-40b0-a505-cbf763d4d7bd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:26.234681 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4bfe8efa-95e9-40b0-a505-cbf763d4d7bd tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059217 Aug 10 11:23:26.235647 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 432/875] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:23:26 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:27.017605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:27.018333 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:27.021688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:27.026662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.027152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.027587 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.028324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.028728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.029155 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.181650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:27.191314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:27.192854 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:27.194233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a97cc2d3-4b1c-40a8-a426-69db78cfbe13 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.180909 Aug 10 11:23:27.194832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 444/876] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:27 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:27.215931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f5f9c4c9-2a0a-4e85-98da-ceba1515d9bf req-e093b259-980b-4742-b8fd-b2b86cc4e500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00252e7d-b9e4-4476-a984-b33aa7286520", "name": "network-vif-plugged", "status": "completed", "tag": "70b8271c-1d70-4963-bf31-d732658386fc"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:27.226484 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f5f9c4c9-2a0a-4e85-98da-ceba1515d9bf req-e093b259-980b-4742-b8fd-b2b86cc4e500 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.227083 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f5f9c4c9-2a0a-4e85-98da-ceba1515d9bf req-e093b259-980b-4742-b8fd-b2b86cc4e500 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.227498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f5f9c4c9-2a0a-4e85-98da-ceba1515d9bf req-e093b259-980b-4742-b8fd-b2b86cc4e500 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.240319 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f5f9c4c9-2a0a-4e85-98da-ceba1515d9bf req-e093b259-980b-4742-b8fd-b2b86cc4e500 service nova] Creating event network-vif-plugged:70b8271c-1d70-4963-bf31-d732658386fc for instance 00252e7d-b9e4-4476-a984-b33aa7286520 on hv-cinder-85272 Aug 10 11:23:27.246381 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f5f9c4c9-2a0a-4e85-98da-ceba1515d9bf req-e093b259-980b-4742-b8fd-b2b86cc4e500 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035143 Aug 10 11:23:27.247404 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 433/877] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:27.249535 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3c838f52-87e7-4f0a-9a65-7baf31577efb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:27.252008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3c838f52-87e7-4f0a-9a65-7baf31577efb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:27.257901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c838f52-87e7-4f0a-9a65-7baf31577efb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.258378 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c838f52-87e7-4f0a-9a65-7baf31577efb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.258836 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c838f52-87e7-4f0a-9a65-7baf31577efb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.260075 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c838f52-87e7-4f0a-9a65-7baf31577efb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.260529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c838f52-87e7-4f0a-9a65-7baf31577efb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.260947 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3c838f52-87e7-4f0a-9a65-7baf31577efb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.290062 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3c838f52-87e7-4f0a-9a65-7baf31577efb tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044734 Aug 10 11:23:27.291242 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 445/878] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:23:27 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 11:23:27.360350 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:27.360938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:27.367732 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.368220 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.369274 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.370029 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.370483 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.371611 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.409727 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:23:27.488542 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3d6c5b62-fccd-49ce-b32c-8445decce31e tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 204 len: 0 microversion: 2.1 time: 0.133375 Aug 10 11:23:27.489393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 434/879] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:23:27 2022] DELETE /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:23:27.498695 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:27.499549 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:27.505662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.506349 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.506908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.507829 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.508290 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.508713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.636139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:27.644100 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9a22f2da-289f-4368-8831-e899e598008b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1680 microversion: 2.1 time: 0.150181 Aug 10 11:23:27.644679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 446/880] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:27 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:28.221218 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:28.221821 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:28.230456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.231050 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.231511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.232294 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.233102 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.233468 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.406264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.417820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.419108 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.420528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3974e183-2808-454e-9505-e5fa5dee8eec tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.203672 Aug 10 11:23:28.421176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 435/881] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:28 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:28.665429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:28.666050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:28.672666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.673091 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.673526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.674219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.674702 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.675153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.829149 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.836853 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8604fb69-0418-400a-a36f-b810cf1edb60 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1680 microversion: 2.1 time: 0.175361 Aug 10 11:23:28.837465 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 447/882] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:28 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:29.444192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:29.444841 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:29.452360 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.453152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.453846 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.454974 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.455711 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.456366 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.475003 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:29.847276 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:29.856482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:29.858368 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:29.859281 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:29.860399 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-45289ad4-cdee-47e0-bc28-76904a10c99a tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.420143 Aug 10 11:23:29.861102 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:29.870413 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.871093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.871563 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.872237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.872688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.873106 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.874797 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 436/883] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:29 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:30.019292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:30.028753 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-27782988-ce42-44db-98ac-1a3188e983de tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1680 microversion: 2.1 time: 0.174387 Aug 10 11:23:30.029339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 448/884] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:29 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:30.885582 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:30.886194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:30.892671 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.893162 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.893602 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.894305 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.894786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.895215 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:31.050874 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:31.051650 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:31.059883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:31.060386 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:31.061042 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:31.062295 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:31.062976 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:31.063435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:31.164877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a30897a10d8467aa294f24954368a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d9cb4aa3484f95bad54f2233a08439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:31.175731 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c7c56688-1436-40fa-b8c7-49d58b6a1fe1 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 200 len: 1613 microversion: 2.1 time: 0.128630 Aug 10 11:23:31.178655 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 449/885] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:31 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 1613 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:31.179557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:31.189026 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:31.190848 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:31.192030 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c1ba979-39d6-4316-96ab-db0c65a1eb3f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1733 microversion: 2.20 time: 0.311019 Aug 10 11:23:31.196150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 437/886] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:30 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1733 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:31.381569 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-81b282b0-d363-4fc0-bf77-503a79dfc09c req-807342c8-2d31-4c5c-b41b-caf6b3bac54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3620ef46-8dfe-419a-88b2-d8e25e9e9ca8", "name": "network-vif-deleted", "tag": "c98c9742-65a1-4765-87f9-866c658b4e79"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:31.393671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-81b282b0-d363-4fc0-bf77-503a79dfc09c req-807342c8-2d31-4c5c-b41b-caf6b3bac54a service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:31.394426 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-81b282b0-d363-4fc0-bf77-503a79dfc09c req-807342c8-2d31-4c5c-b41b-caf6b3bac54a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:31.395060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-81b282b0-d363-4fc0-bf77-503a79dfc09c req-807342c8-2d31-4c5c-b41b-caf6b3bac54a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:31.415074 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-81b282b0-d363-4fc0-bf77-503a79dfc09c req-807342c8-2d31-4c5c-b41b-caf6b3bac54a service nova] Creating event network-vif-deleted:c98c9742-65a1-4765-87f9-866c658b4e79 for instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 on hv-cinder-85272 Aug 10 11:23:31.421544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-81b282b0-d363-4fc0-bf77-503a79dfc09c req-807342c8-2d31-4c5c-b41b-caf6b3bac54a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044970 Aug 10 11:23:31.426531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 450/887] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:32.196953 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:32.198338 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:32.204746 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:32.205245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:32.205750 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.206470 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:32.206963 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:32.207407 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.220658 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:32.222020 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:32.222504 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 HTTP/1.1 Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:23:32.224231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:32.225977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '3620ef46-8dfe-419a-88b2-d8e25e9e9ca8'} Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:32.226933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:32.229236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:32.230783 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:32.230783 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02289396-b4b2-43b1-8933-99483ec0c706 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 404 len: 111 microversion: 2.1 time: 0.032995 Aug 10 11:23:32.230783 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 438/888] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:32 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:32.233163 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:32.233732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:32.234243 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.235060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:32.235514 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-77b79c09-794c-47c4-a147-5bc360805653 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '.version_select at 0x7fccf2f925e0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:32.235631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:32.236015 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.256290 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-77b79c09-794c-47c4-a147-5bc360805653 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609024536" status: 202 len: 0 microversion: 2.1 time: 0.024308 Aug 10 11:23:32.257084 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 439/889] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 10 11:23:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609024536 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:23:32.416267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:32.419585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:32.429956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:32.432523 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:32.433716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-48ace117-af2d-4318-95d8-0cd2c67d3302 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1720 microversion: 2.20 time: 0.217896 Aug 10 11:23:32.450754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 451/890] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:32 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:34.394939 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:34.395497 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:34.403366 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:34.403854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:34.404283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:34.404978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:34.405431 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:34.405854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:34.420381 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 HTTP/1.1 Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:23:34.421990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.423648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '3620ef46-8dfe-419a-88b2-d8e25e9e9ca8'} Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:34.424558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.426027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.427541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:34.427541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-235ccc3e-8b13-4dd9-a4ed-ef18054b8a94 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 404 len: 111 microversion: 2.1 time: 0.033056 Aug 10 11:23:34.427541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 440/891] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:23:34 2022] DELETE /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:34.432485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:34.433076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:34.440008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:34.440491 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:34.440922 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:34.441623 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:34.442071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:34.442488 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:34.461864 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 HTTP/1.1 Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:23:34.464045 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.465622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '3620ef46-8dfe-419a-88b2-d8e25e9e9ca8'} Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:34.466528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. Aug 10 11:23:34.468037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:34.469363 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance 3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:34.469363 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bc91ed0a-19e9-421a-8319-e131ec82d59f tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8" status: 404 len: 111 microversion: 2.1 time: 0.037229 Aug 10 11:23:34.469363 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 452/892] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:34 2022] GET /compute/v2.1/servers/3620ef46-8dfe-419a-88b2-d8e25e9e9ca8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:35.615947 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:35.616435 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:35.623533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.624055 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.624482 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.625196 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.625641 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.626064 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.639459 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 HTTP/1.1 Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:23:35.641002 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.642754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': 'f8547aa0-1882-4f7e-8f8c-971de45eb907'} Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:35.643679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.645257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.646659 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:35.646659 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2180028c-4065-4376-99e1-e825b9f6f8e6 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 404 len: 111 microversion: 2.1 time: 0.030240 Aug 10 11:23:35.646659 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 441/893] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:23:35 2022] DELETE /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:35.651160 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:35.651778 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: f8547aa0-1882-4f7e-8f8c-971de45eb907] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:35.658711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.659194 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.659627 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.660323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.660773 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.661203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.676175 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 HTTP/1.1 Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:23:35.677844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.679458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': 'f8547aa0-1882-4f7e-8f8c-971de45eb907'} Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:35.680216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. Aug 10 11:23:35.682055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.684585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance f8547aa0-1882-4f7e-8f8c-971de45eb907 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:35.684585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b5b7863-ff98-417d-bfad-bdf88309786b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907" status: 404 len: 111 microversion: 2.1 time: 0.032194 Aug 10 11:23:35.684585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 453/894] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:35 2022] GET /compute/v2.1/servers/f8547aa0-1882-4f7e-8f8c-971de45eb907 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:35.691785 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:35.692296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:35.699593 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.700084 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.700560 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.701268 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.701823 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.702250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.716934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 HTTP/1.1 Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:23:35.718486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.720109 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '43e362be-7551-4ab4-98ec-7920d5ca5d63'} Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:35.721082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.722660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.724242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:35.724242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb54e385-de1c-42c9-a191-7cdcb19b841b tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 404 len: 111 microversion: 2.1 time: 0.033397 Aug 10 11:23:35.724242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 442/895] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:23:35 2022] DELETE /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:35.728521 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:35.729161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 43e362be-7551-4ab4-98ec-7920d5ca5d63] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:35.735287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.735810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.736247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.736940 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.737565 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.737990 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.753130 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 HTTP/1.1 Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:23:35.754953 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.756331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '43e362be-7551-4ab4-98ec-7920d5ca5d63'} Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:35.757082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. Aug 10 11:23:35.758347 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:35.760221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance 43e362be-7551-4ab4-98ec-7920d5ca5d63 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:35.760221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1e15ebe6-09ed-45ef-a60d-146f29784525 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63" status: 404 len: 111 microversion: 2.1 time: 0.031815 Aug 10 11:23:35.760603 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 454/896] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:35 2022] GET /compute/v2.1/servers/43e362be-7551-4ab4-98ec-7920d5ca5d63 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:36.898677 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:36.899183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:36.906031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:36.906507 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:36.906974 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:36.907658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:36.908105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:36.908527 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:36.922003 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a HTTP/1.1 Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:23:36.923523 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.925008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '416de879-4113-49f9-b2a9-04398bd17e4a'} Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:36.925756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.927031 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.928335 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:36.928335 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5e7eece-a501-4884-bc41-08b3686db796 tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 404 len: 111 microversion: 2.1 time: 0.030098 Aug 10 11:23:36.928335 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 443/897] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:23:36 2022] DELETE /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:36.933387 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:36.934007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] [instance: 416de879-4113-49f9-b2a9-04398bd17e4a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:36.940066 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:36.940756 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:36.941212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:36.941909 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:36.942368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:36.942835 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:36.956295 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] HTTP exception thrown: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Request method failure captured: Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a HTTP/1.1 Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85LDh3AkpVcdOzyK6I8lpn2hUTjWZZXRQPCl-PZgkNqI2WsKVidzqcknjcq50OWUWOKdtSqzGIQauzZQBegBjVmEj1YC6n-EdQThhGq35tPJB2k6-vGkoJEgbdEKorci4Vhuq9vQeJbH8IEQL8881xPiKSZsqGTwQHTdWuJhY-fuDfY Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:23:36.957902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47d9cb4aa3484f95bad54f2233a08439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 47d9cb4aa3484f95bad54f2233a08439 Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1346018739 Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 0a30897a10d8467aa294f24954368a84 Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1346018739-project Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.959605 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '416de879-4113-49f9-b2a9-04398bd17e4a'} Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:36.960709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. Aug 10 11:23:36.962208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:23:36.964095 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] Returning 404 to user: Instance 416de879-4113-49f9-b2a9-04398bd17e4a could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:36.964095 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2ff49aab-addc-435e-9783-0f5d766360ac tempest-AttachVolumeNegativeTest-1346018739 tempest-AttachVolumeNegativeTest-1346018739-project] 10.222.0.49 "GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a" status: 404 len: 111 microversion: 2.1 time: 0.029967 Aug 10 11:23:36.964095 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 455/898] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:36 2022] GET /compute/v2.1/servers/416de879-4113-49f9-b2a9-04398bd17e4a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:39.041113 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:23:39.041648 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Wed Aug 10 11:23:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:23:41.219878 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-79f6635c-5c6f-4abb-b5dd-26bf4cfa7866 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Action: 'create', calling method: .version_select at 0x7fccf81031f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1623417351", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:41.556096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-79f6635c-5c6f-4abb-b5dd-26bf4cfa7866 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.449361 Aug 10 11:23:41.556766 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 444/899] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 10 11:23:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 451 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 11:23:41.569006 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-871d3246-aac3-4ab9-acd8-ea2cf6b9d16e tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf3739e50>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:41.623534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-871d3246-aac3-4ab9-acd8-ea2cf6b9d16e tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 200 len: 353 microversion: 2.1 time: 0.058246 Aug 10 11:23:41.624107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 456/900] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:41 2022] GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:42.643656 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4006f1a-9302-453f-9318-03ad34901f9b tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf80d1d30>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:42.723859 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4006f1a-9302-453f-9318-03ad34901f9b tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 200 len: 353 microversion: 2.1 time: 0.087762 Aug 10 11:23:42.724818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 445/901] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:42 2022] GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:43.741059 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7bc1bb14-8bb6-4bb9-b6e0-4e186fb165ac tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf372b0d0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:43.787703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7bc1bb14-8bb6-4bb9-b6e0-4e186fb165ac tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 200 len: 353 microversion: 2.1 time: 0.051005 Aug 10 11:23:43.788263 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 457/902] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:43 2022] GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:44.801977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a3b5f351-56cb-42a3-8587-68fde7bb9fe2 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf8440d30>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:44.849851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a3b5f351-56cb-42a3-8587-68fde7bb9fe2 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 200 len: 353 microversion: 2.1 time: 0.052176 Aug 10 11:23:44.850462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 446/903] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:44 2022] GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:45.864687 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fa0e9e84-1160-4e52-9192-26e74145ea4c tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf81b6ca0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:45.911312 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fa0e9e84-1160-4e52-9192-26e74145ea4c tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 200 len: 353 microversion: 2.1 time: 0.050978 Aug 10 11:23:45.911884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 458/904] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:45 2022] GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:46.922371 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:46.923148 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=19 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:46.926942 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f3cafced-c96c-4f22-bdf8-ee9305616b02 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf80e2430>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:46.979292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f3cafced-c96c-4f22-bdf8-ee9305616b02 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 200 len: 354 microversion: 2.1 time: 0.057003 Aug 10 11:23:46.979875 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 447/905] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:46 2022] GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:46.989823 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=23 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:46.990600 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=9 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:46.995077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3a03fb05-1981-41c1-9aea-5b049bcce079 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf810f5e0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:47.041667 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3a03fb05-1981-41c1-9aea-5b049bcce079 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 200 len: 354 microversion: 2.1 time: 0.052905 Aug 10 11:23:47.042242 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 459/906] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:46 2022] GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:47.060181 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9fb4d05c-b7d2-4ef0-919a-5f9192bcc97b tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf2f08550>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:47.124621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9fb4d05c-b7d2-4ef0-919a-5f9192bcc97b tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 202 len: 0 microversion: 2.1 time: 0.068862 Aug 10 11:23:47.125193 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 448/907] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:23:47 2022] DELETE /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:23:47.135185 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-90708264-d47e-4d26-847c-f151c6ad33c0 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf80c18b0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:47.184824 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-90708264-d47e-4d26-847c-f151c6ad33c0 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 200 len: 353 microversion: 2.1 time: 0.054807 Aug 10 11:23:47.185447 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 460/908] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:47 2022] GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:48.199923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cc026c45-2243-48ce-ab8d-540f27ac1365 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Calling method '.version_select at 0x7fccf8103ca0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:48.227138 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-cc026c45-2243-48ce-ab8d-540f27ac1365 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] HTTP exception thrown: Volume de1aa5b4-ec4e-46d5-8dd7-aea27e700566 could not be found. Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cc026c45-2243-48ce-ab8d-540f27ac1365 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Request method failure captured: Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 HTTP/1.1 Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85U9kQ5q1CMEpnt4lckBuApafSmk015b3IPu1BW1SoAOatFN3yKyBzUOvvN8w24EBk-c05T-cOuJQf_FPYNCj5iV9uOz-0g7OP6_s_tutX4JD-lcALG1ccj3CH3Yx4kN1heK_LB904-EWn7xVkuf5jaSb4qtzUntj6BffFdU71TvIO0 Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 467f8310c7784773a07b2ac810316ef0 Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesGetTestJSON-1016313509 Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:23:48.229169 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/467f8310c7784773a07b2ac810316ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467f8310c7784773a07b2ac810316ef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467f8310c7784773a07b2ac810316ef0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_467f8310c7784773a07b2ac810316ef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesGetTestJSON-1016313509 Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 467f8310c7784773a07b2ac810316ef0 Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesGetTestJSON-1016313509 Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesGetTestJSON-1016313509-project Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: f82260a02326446db102c85ec3de0640 Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesGetTestJSON-1016313509-project Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Volume de1aa5b4-ec4e-46d5-8dd7-aea27e700566 could not be found. Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': 'de1aa5b4-ec4e-46d5-8dd7-aea27e700566'} Aug 10 11:23:48.230894 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de1aa5b4-ec4e-46d5-8dd7-aea27e700566 could not be found. (HTTP 404) (Request-ID: req-a4005b6e-5e90-44b5-b1c4-abd54cd10074) Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:48.232041 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:48.233556 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de1aa5b4-ec4e-46d5-8dd7-aea27e700566 could not be found. Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:23:48.235398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de1aa5b4-ec4e-46d5-8dd7-aea27e700566 could not be found. Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de1aa5b4-ec4e-46d5-8dd7-aea27e700566 could not be found. Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cc026c45-2243-48ce-ab8d-540f27ac1365 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] Returning 404 to user: Volume de1aa5b4-ec4e-46d5-8dd7-aea27e700566 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cc026c45-2243-48ce-ab8d-540f27ac1365 tempest-VolumesGetTestJSON-1016313509 tempest-VolumesGetTestJSON-1016313509-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566" status: 404 len: 109 microversion: 2.1 time: 0.035991 Aug 10 11:23:48.236851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 449/909] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:48 2022] GET /compute/v2.1/os-volumes/de1aa5b4-ec4e-46d5-8dd7-aea27e700566 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:13.065495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1123335035", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "networks": [{"uuid": "f9513038-0ccc-4313-86d0-b1c49bd4105d"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:13.135504 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] validate_networks() for [('f9513038-0ccc-4313-86d0-b1c49bd4105d', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:24:13.549530 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:24:13.549955 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:24:13.550433 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:24:13.550876 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:24:13.551297 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:24:13.560662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:13.561152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:13.561586 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:13.562322 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:13.562810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:13.563243 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:13.582193 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Getting quotas for project 4b5056dc2a8244a0bc6d9a72147a0e7f. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:24:13.587667 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Getting quotas for user 91af9ceecb6f4bdc8411e73b47e91dcd and project 4b5056dc2a8244a0bc6d9a72147a0e7f. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:24:13.600077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:24:13.602331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:24:13.649321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7c86e568-5995-4b4e-8aa0-ed1a1dbe9e6d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588576 Aug 10 11:24:13.651598 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 461/910] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:24:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:24:13.662213 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0fdc5c4a-f937-4814-bcd3-e2bb85516240 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:13.662880 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0fdc5c4a-f937-4814-bcd3-e2bb85516240 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:13.719344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0fdc5c4a-f937-4814-bcd3-e2bb85516240 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:13.726230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0fdc5c4a-f937-4814-bcd3-e2bb85516240 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1214 microversion: 2.1 time: 0.068637 Aug 10 11:24:13.727192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 450/911] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:13 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:14.751658 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-df2a0a0c-7ed8-4035-bd57-131213ceae0f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:14.752720 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-df2a0a0c-7ed8-4035-bd57-131213ceae0f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:14.810434 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-df2a0a0c-7ed8-4035-bd57-131213ceae0f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:14.821118 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-df2a0a0c-7ed8-4035-bd57-131213ceae0f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1214 microversion: 2.1 time: 0.075367 Aug 10 11:24:14.822178 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 462/912] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:14 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:15.846956 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75e82d50-4b0c-49f6-a18a-9c8b8082cf8b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:15.847854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-75e82d50-4b0c-49f6-a18a-9c8b8082cf8b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:15.933403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-75e82d50-4b0c-49f6-a18a-9c8b8082cf8b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:15.945668 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-75e82d50-4b0c-49f6-a18a-9c8b8082cf8b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1214 microversion: 2.1 time: 0.104714 Aug 10 11:24:15.959070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 451/913] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:15 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:16.969876 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-986a52b8-6f57-499e-8085-24ec310f1444 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:16.970500 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-986a52b8-6f57-499e-8085-24ec310f1444 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:17.024587 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-986a52b8-6f57-499e-8085-24ec310f1444 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:17.032720 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-986a52b8-6f57-499e-8085-24ec310f1444 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1214 microversion: 2.1 time: 0.068412 Aug 10 11:24:17.033295 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 463/914] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:16 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:18.053612 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:18.055218 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:18.062899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.063407 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.063847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.064803 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.065479 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.065905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.182388 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:18.190778 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee0edfe7-c7d7-422c-8b4b-d5d14fc49683 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1218 microversion: 2.1 time: 0.141489 Aug 10 11:24:18.191374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 452/915] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:18 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:19.213819 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:19.214440 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:19.223367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:19.224147 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:19.224621 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:19.225599 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:19.226068 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:19.226755 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:19.298704 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:19.306231 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b5036072-7545-4765-97be-806eade8a445 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1272 microversion: 2.1 time: 0.096485 Aug 10 11:24:19.307537 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 464/916] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:19 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:20.145722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1800808741", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "networks": [{"uuid": "afd201d7-bb2d-43af-b661-037d5589921f"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:20.204785 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] validate_networks() for [('afd201d7-bb2d-43af-b661-037d5589921f', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:24:20.327397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:20.327968 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:20.334869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:20.335364 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:20.335810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:20.336525 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:20.336980 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:20.337410 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:20.657914 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:20.666528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1546628e-460f-4544-9f38-e2740a215bd4 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1314 microversion: 2.1 time: 0.342903 Aug 10 11:24:20.667123 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 465/917] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:20 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:20.937079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-4bcf15c8-2270-483e-99ca-c3b1b139555e req-bf18ea22-3d76-45c2-bb40-25b5022dacee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd38c3c-8e76-49bc-b829-9bc4ecf097a3", "tag": "28b6bd0f-0533-4e0d-bfb6-966fe38d004e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:20.949194 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-4bcf15c8-2270-483e-99ca-c3b1b139555e req-bf18ea22-3d76-45c2-bb40-25b5022dacee service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:20.949810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-4bcf15c8-2270-483e-99ca-c3b1b139555e req-bf18ea22-3d76-45c2-bb40-25b5022dacee service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:20.950449 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-4bcf15c8-2270-483e-99ca-c3b1b139555e req-bf18ea22-3d76-45c2-bb40-25b5022dacee service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:20.963680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-4bcf15c8-2270-483e-99ca-c3b1b139555e req-bf18ea22-3d76-45c2-bb40-25b5022dacee service nova] Creating event network-changed:28b6bd0f-0533-4e0d-bfb6-966fe38d004e for instance 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 on hv-cinder-85272 Aug 10 11:24:20.969268 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-4bcf15c8-2270-483e-99ca-c3b1b139555e req-bf18ea22-3d76-45c2-bb40-25b5022dacee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193392 Aug 10 11:24:20.969872 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 466/918] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:24:21.179211 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:24:21.179999 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:24:21.180192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:24:21.180732 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:24:21.181246 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:24:21.191738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:21.192232 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:21.192679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:21.193418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:21.193877 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:21.194307 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:21.213168 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Getting quotas for project 50beb48049264dfe8b6a75937c1041fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:24:21.217221 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Getting quotas for user 3de54cdce7634d7d9519722cfb67d45e and project 50beb48049264dfe8b6a75937c1041fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:24:21.230639 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:24:21.233385 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:24:21.282981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1a41a45-79ae-45d1-b66d-90384467d7a9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141089 Aug 10 11:24:21.283872 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 453/919] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:24:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:24:21.295389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0f403eb6-2bdc-46d9-976c-be93dbccfa33 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:21.296387 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0f403eb6-2bdc-46d9-976c-be93dbccfa33 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:21.358681 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0f403eb6-2bdc-46d9-976c-be93dbccfa33 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:21.367258 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0f403eb6-2bdc-46d9-976c-be93dbccfa33 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1219 microversion: 2.1 time: 0.076527 Aug 10 11:24:21.367916 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 467/920] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:21 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:21.689725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:21.690472 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:21.700032 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:21.700518 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:21.701210 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:21.701905 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:21.702355 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:21.702804 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:21.830412 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:21.838015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-24012346-1ca1-4a35-8b5c-517a519b2c8a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1314 microversion: 2.1 time: 0.153144 Aug 10 11:24:21.838601 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 454/921] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:21 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:22.390162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:22.390812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:22.398206 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:22.398731 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:22.399196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:22.399940 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:22.400442 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:22.401435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:22.466814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:22.474675 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-be7884f4-9ba2-4401-9aa2-db54cb22ade2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1223 microversion: 2.1 time: 0.088676 Aug 10 11:24:22.475215 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 468/922] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:22 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:22.859642 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:22.860255 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:22.866849 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:22.867339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:22.867778 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:22.868480 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:22.868937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:22.870030 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:23.020187 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:23.028415 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dfbaf195-c356-4e94-9327-bb947ac51a38 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1314 microversion: 2.1 time: 0.172591 Aug 10 11:24:23.028982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 455/923] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:22 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:23.497415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:23.498061 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:23.505515 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:23.506016 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:23.506454 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:23.511409 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:23.511894 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:23.512339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:23.570194 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:23.586516 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:23.599412 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-570b5b8e-d44d-421a-80a1-90c777ebdc5f tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1223 microversion: 2.1 time: 0.107537 Aug 10 11:24:23.600011 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 469/924] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:23 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:24.049701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:24.050343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:24.057509 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:24.057999 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:24.058435 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:24.059165 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:24.059618 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:24.060039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:24.259077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:24.271611 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4dae8f58-824d-4632-881b-a8dc889c345c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1314 microversion: 2.1 time: 0.226102 Aug 10 11:24:24.272932 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 456/925] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:24 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:24.626206 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:24.627203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:24.634292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:24.635369 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:24.635818 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:24.636537 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:24.637001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:24.637434 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:24.728078 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:24.739383 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fed2d719-72dc-46b8-92d2-6d523d84264e tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1277 microversion: 2.1 time: 0.118464 Aug 10 11:24:24.746699 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 470/926] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:24 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:25.293660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:25.294557 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:25.303624 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.304134 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.304581 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.305296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.305786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.306218 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.476807 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:25.485965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c9171a36-d579-404e-a2b9-8c9d8431cff5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1314 microversion: 2.1 time: 0.196769 Aug 10 11:24:25.487104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 457/927] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:25 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:25.637020 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-d075a5f5-4ba8-4ce9-824f-bbdd81a83c79 req-aaf3c703-00d4-49fc-a714-06ac873971a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd38c3c-8e76-49bc-b829-9bc4ecf097a3", "name": "network-vif-plugged", "status": "completed", "tag": "28b6bd0f-0533-4e0d-bfb6-966fe38d004e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:25.647519 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d075a5f5-4ba8-4ce9-824f-bbdd81a83c79 req-aaf3c703-00d4-49fc-a714-06ac873971a2 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.648006 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d075a5f5-4ba8-4ce9-824f-bbdd81a83c79 req-aaf3c703-00d4-49fc-a714-06ac873971a2 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.648438 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d075a5f5-4ba8-4ce9-824f-bbdd81a83c79 req-aaf3c703-00d4-49fc-a714-06ac873971a2 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.663179 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-d075a5f5-4ba8-4ce9-824f-bbdd81a83c79 req-aaf3c703-00d4-49fc-a714-06ac873971a2 service nova] Creating event network-vif-plugged:28b6bd0f-0533-4e0d-bfb6-966fe38d004e for instance 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 on hv-cinder-85272 Aug 10 11:24:25.669591 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-d075a5f5-4ba8-4ce9-824f-bbdd81a83c79 req-aaf3c703-00d4-49fc-a714-06ac873971a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105801 Aug 10 11:24:25.670201 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 471/928] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:25.764991 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:25.765984 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:25.772776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.773256 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.773895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.774637 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.775091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.775642 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.953509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:25.954139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:25.960900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.961411 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.961856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.962607 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.963118 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.963777 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.991349 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lazy-loading 'flavor' on Instance uuid 210aa1a7-389f-4708-9b3a-e0919befdaef {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:24:25.996095 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:26.011281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb393be9-07a5-4d66-a983-b1f149f098ad tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1319 microversion: 2.1 time: 0.249839 Aug 10 11:24:26.012299 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 458/929] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:25 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:26.092766 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a319968b-e159-4a5e-b11a-8ff08fb9f8d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "POST /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef/action" status: 202 len: 0 microversion: 2.1 time: 0.142675 Aug 10 11:24:26.096596 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 472/930] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:24:25 2022] POST /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:24:26.105613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:26.106350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:26.113172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:26.113668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:26.114623 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:26.115079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:26.115503 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:26.115935 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:26.163559 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f67d9fd8-c798-4e67-9eaf-9f3331ff2fc9 req-f6de0340-6201-4cdd-9f70-0f24198f402e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbefd723-b07e-47f2-8756-1ac1c062d310", "tag": "7b51d0a3-a223-437f-81c1-4e7ba33fe27e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:26.173193 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f67d9fd8-c798-4e67-9eaf-9f3331ff2fc9 req-f6de0340-6201-4cdd-9f70-0f24198f402e service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:26.173667 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f67d9fd8-c798-4e67-9eaf-9f3331ff2fc9 req-f6de0340-6201-4cdd-9f70-0f24198f402e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:26.174097 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f67d9fd8-c798-4e67-9eaf-9f3331ff2fc9 req-f6de0340-6201-4cdd-9f70-0f24198f402e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:26.186015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f67d9fd8-c798-4e67-9eaf-9f3331ff2fc9 req-f6de0340-6201-4cdd-9f70-0f24198f402e service nova] Creating event network-changed:7b51d0a3-a223-437f-81c1-4e7ba33fe27e for instance cbefd723-b07e-47f2-8756-1ac1c062d310 on hv-cinder-85272 Aug 10 11:24:26.191064 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f67d9fd8-c798-4e67-9eaf-9f3331ff2fc9 req-f6de0340-6201-4cdd-9f70-0f24198f402e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095517 Aug 10 11:24:26.191698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 459/931] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:24:26.264296 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:26.271950 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3bb87bb5-ac6d-4ff0-b80b-36ff8380fc5f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.171380 Aug 10 11:24:26.272532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 473/932] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:26 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:26.510545 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:26.511648 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:26.518323 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:26.518830 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:26.519305 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:26.520061 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:26.520516 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:26.520981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:26.684709 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:26.698299 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23064fea-96a9-4768-accf-776bb10ab30b tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1314 microversion: 2.1 time: 0.192416 Aug 10 11:24:26.698918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 460/933] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:26 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:27.041997 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:27.042619 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:27.049270 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.049779 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.050213 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.050943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.051393 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.051814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.187103 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:27.194995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1d186b16-c290-4eac-88bf-28d745da1c0d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1319 microversion: 2.1 time: 0.157357 Aug 10 11:24:27.195556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 474/934] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:27 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:27.294910 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:27.295619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:27.302957 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.303532 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.304052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.304942 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.305406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.305918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.455288 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:27.463017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-adec481c-3fac-4abf-a185-59c8e5c82101 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.173189 Aug 10 11:24:27.463613 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 461/935] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:27 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:27.731583 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:27.733292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:27.741053 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.741564 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.742130 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.743810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.744400 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.744880 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.899070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:27.907391 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7261b62d-0eb5-41de-99a5-442fdd406e98 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1314 microversion: 2.1 time: 0.182141 Aug 10 11:24:27.908115 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 475/936] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:27 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:28.225707 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:28.226440 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:28.234186 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:28.234808 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:28.235312 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:28.236107 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:28.236725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:28.237377 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:28.413341 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:28.424674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4590ba85-2ee4-4ec2-a14b-d92f73d83bf2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1319 microversion: 2.1 time: 0.203067 Aug 10 11:24:28.425563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 462/937] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:28 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:28.492355 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:28.493367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:28.503727 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:28.504485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:28.505081 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:28.506200 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:28.507049 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:28.507511 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:28.672533 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:28.686050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-63f88d44-a9c4-4c8b-b0e7-f9623de39a2f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.200976 Aug 10 11:24:28.687163 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 476/938] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:28 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:28.928262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:28.928881 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:28.935259 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:28.935738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:28.936179 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:28.936891 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:28.937339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:28.937755 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.083089 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:29.095375 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6b8d4231-bea2-4fa8-b335-6b5fd41c1ff0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1497 microversion: 2.1 time: 0.170811 Aug 10 11:24:29.095911 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 463/939] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:28 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:29.463511 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:29.464489 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:29.473405 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:29.473908 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:29.474362 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.475112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:29.475572 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:29.476004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.648969 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:29.661448 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b5e89cc-290c-49dc-b716-222589285cbf tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1319 microversion: 2.1 time: 0.202599 Aug 10 11:24:29.662458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 477/940] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:29 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:29.679344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:29.680499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:29.687989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:29.688582 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:29.689120 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.690098 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:29.690702 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:29.691192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.710829 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:29.711593 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:29.719797 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:29.720556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:29.721179 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.721935 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:24:29.722328 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:29.723065 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:29.723684 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.819235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-36044618-744e-4347-820c-605f1a4969be tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 204 len: 0 microversion: 2.1 time: 0.144619 Aug 10 11:24:29.820180 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 464/941] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:24:29 2022] DELETE /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:24:29.832014 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:29.832943 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:29.841621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:29.842193 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:29.842938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.843952 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:29.844639 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:29.845439 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.896819 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:29.910409 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-95983eb9-1e11-4b96-b6fe-d9da636069fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.203397 Aug 10 11:24:29.911504 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 478/942] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:29 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:30.012832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:30.020600 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1ba651bf-d739-4e64-bf2b-1d9319f2e75a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1503 microversion: 2.1 time: 0.195201 Aug 10 11:24:30.021174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 465/943] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:29 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:30.685190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:30.685927 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:30.694348 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:30.697082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:30.698187 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:30.698961 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:30.699435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:30.699870 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:30.869476 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:30.880654 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7e0256d3-dd89-457c-bcf5-6bfd0c4bdc5a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1319 microversion: 2.1 time: 0.199451 Aug 10 11:24:30.883074 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 479/944] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:30 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:30.940008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:30.940777 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:30.947713 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:30.948255 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:30.948692 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:30.949409 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:30.949917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:30.950343 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:31.045484 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:31.046162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:31.055483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:31.056027 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:31.056497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:31.057587 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:31.057954 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:31.058516 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:31.082535 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:31.132923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:31.144966 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e1a928b-b63e-4e1c-9afb-b801054b0e0f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.209079 Aug 10 11:24:31.146021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 466/945] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:30 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:31.235608 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:31.243726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b909b8ba-a9ec-4e53-bc1a-10e9dbba5617 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1503 microversion: 2.1 time: 0.204355 Aug 10 11:24:31.244434 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 480/946] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:31 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:31.905453 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:31.906166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:31.909342 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:31.910137 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=10 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:31.919517 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:31.920281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:31.921014 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:31.922269 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:31.922876 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:31.923365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:32.099264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:32.110971 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b337e2a0-ec19-45c9-bb83-4a80bd853394 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1319 microversion: 2.1 time: 0.210126 Aug 10 11:24:32.111919 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 467/947] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:31 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:32.170180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:32.170884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:32.172726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=12 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:32.179321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:32.180728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:32.180728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:32.180728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:32.182249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:32.182249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:32.268333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:32.269126 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:32.275932 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:32.276829 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:32.277757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:32.279250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:32.279976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:32.280633 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:32.286631 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:32.409222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:32.419889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ef7c1285-a0f6-4f30-a36f-16ab2b086a86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.253528 Aug 10 11:24:32.420766 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 481/948] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:32 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:32.476992 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:32.486071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-367fbaef-2d6b-41d2-b2e6-b6655b456214 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1503 microversion: 2.1 time: 0.222628 Aug 10 11:24:32.486667 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 468/949] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:32 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:33.132927 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:33.133681 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:33.140921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.141473 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.142009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.142792 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.143248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.143669 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.209739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a9d6a040-876e-4929-a44a-828b8591eec2 req-0ae90bae-9af2-4cf7-9ace-a62c7e9a9f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd38c3c-8e76-49bc-b829-9bc4ecf097a3", "name": "network-vif-deleted", "tag": "28b6bd0f-0533-4e0d-bfb6-966fe38d004e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:33.221196 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a9d6a040-876e-4929-a44a-828b8591eec2 req-0ae90bae-9af2-4cf7-9ace-a62c7e9a9f16 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.221740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a9d6a040-876e-4929-a44a-828b8591eec2 req-0ae90bae-9af2-4cf7-9ace-a62c7e9a9f16 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.222722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a9d6a040-876e-4929-a44a-828b8591eec2 req-0ae90bae-9af2-4cf7-9ace-a62c7e9a9f16 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.235295 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a9d6a040-876e-4929-a44a-828b8591eec2 req-0ae90bae-9af2-4cf7-9ace-a62c7e9a9f16 service nova] Creating event network-vif-deleted:28b6bd0f-0533-4e0d-bfb6-966fe38d004e for instance 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 on hv-cinder-85272 Aug 10 11:24:33.241802 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a9d6a040-876e-4929-a44a-828b8591eec2 req-0ae90bae-9af2-4cf7-9ace-a62c7e9a9f16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036345 Aug 10 11:24:33.242533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 469/950] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:24:33.286917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:33.295164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3444fb2e-b107-4f7a-8a08-6b6b400df907 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1319 microversion: 2.1 time: 0.166140 Aug 10 11:24:33.295983 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 482/951] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:33 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:33.442326 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:33.442982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:33.449959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.450368 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.450832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.451791 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.452244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.452669 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.507429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:33.508158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:33.515020 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.515783 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.516368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.517079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.517776 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.518138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.554797 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.555287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.555734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.556372 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lazy-loading 'fault' on Instance uuid 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:24:33.614836 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:33.618447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:33.626184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-260d7cab-3ba3-401a-9e28-3544d4dcb727 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 200 len: 1304 microversion: 2.1 time: 0.122501 Aug 10 11:24:33.627257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c33158c4-940a-427d-9623-b89627b0817b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.189196 Aug 10 11:24:33.627848 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 483/952] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:33 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:33.628956 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 470/953] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:33 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:33.667252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-ae5ba527-ce47-4f55-a6e5-82d2f53d4059 req-f2c75c0a-d1b1-4473-9917-0bf53c124ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbefd723-b07e-47f2-8756-1ac1c062d310", "name": "network-vif-plugged", "status": "completed", "tag": "7b51d0a3-a223-437f-81c1-4e7ba33fe27e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:33.677483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ae5ba527-ce47-4f55-a6e5-82d2f53d4059 req-f2c75c0a-d1b1-4473-9917-0bf53c124ea1 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.677962 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ae5ba527-ce47-4f55-a6e5-82d2f53d4059 req-f2c75c0a-d1b1-4473-9917-0bf53c124ea1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.678392 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ae5ba527-ce47-4f55-a6e5-82d2f53d4059 req-f2c75c0a-d1b1-4473-9917-0bf53c124ea1 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.696834 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-ae5ba527-ce47-4f55-a6e5-82d2f53d4059 req-f2c75c0a-d1b1-4473-9917-0bf53c124ea1 service nova] Creating event network-vif-plugged:7b51d0a3-a223-437f-81c1-4e7ba33fe27e for instance cbefd723-b07e-47f2-8756-1ac1c062d310 on hv-cinder-85272 Aug 10 11:24:33.704473 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-ae5ba527-ce47-4f55-a6e5-82d2f53d4059 req-f2c75c0a-d1b1-4473-9917-0bf53c124ea1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044395 Aug 10 11:24:33.705473 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 484/954] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:34.317112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:34.317636 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:34.324568 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:34.325048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:34.325478 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:34.326202 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:34.326938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:34.327360 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:34.457621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:34.465047 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3627b561-1699-4042-82a9-2315e4eea3a4 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1319 microversion: 2.1 time: 0.151869 Aug 10 11:24:34.465604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 471/955] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:34 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:34.649190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:34.649958 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:34.654492 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:34.655142 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:34.656781 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:34.657271 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:34.657704 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:34.658401 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:34.658879 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:34.659303 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:34.661194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:34.661686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:34.662355 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:34.663099 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:34.664271 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:34.664738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:34.673910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] HTTP exception thrown: Instance 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 could not be found. Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Request method failure captured: Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 HTTP/1.1 Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85VXSyn5VmsBmpfuwkyH8loL_w1p1S4MIKJUwQxAhmhB_H9_TQjOh8lOounZbJOAZn1CS5mX0LgK59_l8dsmHITe3RQENLeIu_zSLIo7NY2fvihXIw_AjEbzSa-bqiAyox_9pn9wmmf5J-NUuVzlbTrZrjsbmjJsCcjgOmGLN6RkApA Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 4b5056dc2a8244a0bc6d9a72147a0e7f Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesActionsTest-1719527733 Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:24:34.675703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b5056dc2a8244a0bc6d9a72147a0e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b5056dc2a8244a0bc6d9a72147a0e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b5056dc2a8244a0bc6d9a72147a0e7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b5056dc2a8244a0bc6d9a72147a0e7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesActionsTest-1719527733 Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 4b5056dc2a8244a0bc6d9a72147a0e7f Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesActionsTest-1719527733 Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesActionsTest-1719527733-project Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 91af9ceecb6f4bdc8411e73b47e91dcd Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesActionsTest-1719527733-project Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 could not be found. Aug 10 11:24:34.677158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '5bd38c3c-8e76-49bc-b829-9bc4ecf097a3'} Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 could not be found. Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:24:34.678032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 could not be found. Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 could not be found. Aug 10 11:24:34.679435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.680622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Returning 404 to user: Instance 5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:24:34.680622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-75630400-dc48-47f7-92a1-b5b34bd7a87c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3" status: 404 len: 111 microversion: 2.1 time: 0.032280 Aug 10 11:24:34.680622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 485/956] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:34 2022] GET /compute/v2.1/servers/5bd38c3c-8e76-49bc-b829-9bc4ecf097a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:34.778973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1132995025", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "networks": [{"uuid": "f9513038-0ccc-4313-86d0-b1c49bd4105d"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:34.803849 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:34.811837 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a16d1bcb-bcde-4cf2-aeb2-100f1c8119e9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.161204 Aug 10 11:24:34.812400 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 472/957] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:34 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:34.836109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] validate_networks() for [('f9513038-0ccc-4313-86d0-b1c49bd4105d', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:24:35.180461 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:24:35.180913 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:24:35.181392 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:24:35.181808 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:24:35.182224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:24:35.191119 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:35.191599 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:35.192034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:35.192766 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:35.193224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:35.193653 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:35.210357 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Getting quotas for project 4b5056dc2a8244a0bc6d9a72147a0e7f. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:24:35.214856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Getting quotas for user 91af9ceecb6f4bdc8411e73b47e91dcd and project 4b5056dc2a8244a0bc6d9a72147a0e7f. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:24:35.225812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:24:35.228092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:24:35.273567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b6e0d898-cb0d-4f2f-a056-1535a960ccb1 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498364 Aug 10 11:24:35.274241 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 486/958] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:24:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:24:35.285565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-256eb14a-3c03-4a42-b22c-cb6a4cae62f3 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:35.286183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-256eb14a-3c03-4a42-b22c-cb6a4cae62f3 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:35.347830 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-256eb14a-3c03-4a42-b22c-cb6a4cae62f3 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:35.355500 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-256eb14a-3c03-4a42-b22c-cb6a4cae62f3 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1214 microversion: 2.1 time: 0.073577 Aug 10 11:24:35.356080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 473/959] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:35 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:35.485582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:35.486210 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:35.492973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:35.493485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:35.493962 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:35.495352 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:35.495834 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:35.496255 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:35.639795 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:35.649030 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8bc855d2-c965-4c66-ab11-8c7eeeadb008 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1507 microversion: 2.1 time: 0.167318 Aug 10 11:24:35.649918 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 487/960] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:35 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:35.832774 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:35.833385 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:35.839805 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:35.840287 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:35.840722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:35.841408 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:35.841854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:35.842741 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:35.991217 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:36.009077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb0d730c-6a05-4476-ae17-9d4f01829f2b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.179761 Aug 10 11:24:36.026699 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 474/961] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:35 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:36.376715 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:36.377384 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:36.383405 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:36.383889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:36.384325 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:36.385018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:36.385473 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:36.385900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:36.452079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:36.459551 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-28678e2f-355f-43bf-ad29-e78d6c2c5e1f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1266 microversion: 2.1 time: 0.087062 Aug 10 11:24:36.460109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 488/962] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:36 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:37.035931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:37.036609 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:37.043704 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:37.044197 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:37.044641 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:37.045347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:37.045813 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:37.046232 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:37.190051 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:37.199061 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4fe877b9-3cb3-43b1-a659-09b7dbfd6264 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.167044 Aug 10 11:24:37.199667 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 475/963] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:37 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:37.480468 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:37.481081 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:37.487842 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:37.488331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:37.488764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:37.489459 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:37.489939 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:37.490359 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:37.623007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:37.630789 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-890b1d30-25bd-45b9-ba02-2e278332bd33 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1314 microversion: 2.1 time: 0.154072 Aug 10 11:24:37.631371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 489/964] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:37 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:37.978507 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-2c4b6b43-8b61-407d-b377-ba96079f0e7b req-02059532-48e5-4bbd-9418-dfbbcfc788c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eca8aa2-9f0a-476d-bc4c-08a3dcb02663", "tag": "bb357a6f-ec6a-47fe-8bbb-00540829977b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:37.988823 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2c4b6b43-8b61-407d-b377-ba96079f0e7b req-02059532-48e5-4bbd-9418-dfbbcfc788c6 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:37.989397 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2c4b6b43-8b61-407d-b377-ba96079f0e7b req-02059532-48e5-4bbd-9418-dfbbcfc788c6 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:37.990021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2c4b6b43-8b61-407d-b377-ba96079f0e7b req-02059532-48e5-4bbd-9418-dfbbcfc788c6 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:38.005990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-2c4b6b43-8b61-407d-b377-ba96079f0e7b req-02059532-48e5-4bbd-9418-dfbbcfc788c6 service nova] Creating event network-changed:bb357a6f-ec6a-47fe-8bbb-00540829977b for instance 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 on hv-cinder-85272 Aug 10 11:24:38.011157 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-2c4b6b43-8b61-407d-b377-ba96079f0e7b req-02059532-48e5-4bbd-9418-dfbbcfc788c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036397 Aug 10 11:24:38.011850 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 476/965] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:38.221145 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:38.222316 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:38.229600 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:38.230492 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:38.231342 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:38.232300 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:38.232760 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:38.233407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:38.374126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:38.381786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e6cbf367-3083-4f17-bc78-189e2fd2f72c tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.164376 Aug 10 11:24:38.382469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 490/966] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:38 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:38.654057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:38.654867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:38.660922 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:38.661498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:38.661934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:38.662660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:38.663119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:38.663541 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:38.807784 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:38.815793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8b138728-8a56-4db2-b867-c4fb92815586 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1314 microversion: 2.1 time: 0.166658 Aug 10 11:24:38.816363 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 477/967] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:38 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:39.409333 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:39.410021 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:39.423811 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.424305 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.424924 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.426139 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.426636 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.427216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.433205 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:39.433700 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:39.439599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.440084 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.440511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.441447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.442153 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.442822 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.469487 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:24:39.561574 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-beeaac23-d7ce-406b-8056-baa434bdeeb0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 204 len: 0 microversion: 2.1 time: 0.132349 Aug 10 11:24:39.562614 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 478/968] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:24:39 2022] DELETE /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:24:39.571146 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:39.572244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:39.579225 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.579398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.579909 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.580707 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.581236 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.581733 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.587381 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:39.600878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-da7fd5ea-2146-4cbb-9a3b-ecd0c6b5c74b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.202187 Aug 10 11:24:39.601900 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 491/969] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:39 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:39.728700 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:39.736560 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dfb72842-1f73-4a30-9c3c-73985a2191ca tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1576 microversion: 2.1 time: 0.169626 Aug 10 11:24:39.742892 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 479/970] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:39 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:39.837315 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:39.837930 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:39.841812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:39.846124 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.846684 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.847126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.847817 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.848309 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.848734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.988035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:39.996387 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-700fe3c8-3cb9-4419-bcff-2f8fb1f52699 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1314 microversion: 2.1 time: 0.162857 Aug 10 11:24:39.996972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 492/971] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:39 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:40.026748 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ef2ebed9-20c0-4ae2-b8ee-5078695de27b req-94dcfb18-e172-44f3-812e-42c33339e170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dcec59e-6d2c-4ed9-8e46-041d636a208a", "tag": "14591c2b-ed56-404b-961a-a9175299d402"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:40.036884 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ef2ebed9-20c0-4ae2-b8ee-5078695de27b req-94dcfb18-e172-44f3-812e-42c33339e170 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:40.037277 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ef2ebed9-20c0-4ae2-b8ee-5078695de27b req-94dcfb18-e172-44f3-812e-42c33339e170 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:40.037710 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ef2ebed9-20c0-4ae2-b8ee-5078695de27b req-94dcfb18-e172-44f3-812e-42c33339e170 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:40.050331 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ef2ebed9-20c0-4ae2-b8ee-5078695de27b req-94dcfb18-e172-44f3-812e-42c33339e170 service nova] Creating event network-changed:14591c2b-ed56-404b-961a-a9175299d402 for instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a on hv-cinder-85272 Aug 10 11:24:40.055834 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ef2ebed9-20c0-4ae2-b8ee-5078695de27b req-94dcfb18-e172-44f3-812e-42c33339e170 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032945 Aug 10 11:24:40.056449 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 480/972] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:40.623625 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:40.624383 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:40.630596 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:40.631079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:40.631512 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:40.632206 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:40.632655 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:40.633075 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:40.758683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:40.759387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:40.766142 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:40.766691 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:40.767136 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:40.767842 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:40.768300 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:40.768729 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:40.773228 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:40.781032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c1a7d269-a7ec-4295-a057-342d33eb170b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.161721 Aug 10 11:24:40.781607 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 493/973] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:40 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:40.906889 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:40.914495 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b06b7b8f-4a14-4727-949c-51e5d2245e78 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1576 microversion: 2.1 time: 0.160548 Aug 10 11:24:40.915156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 481/974] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:40 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:41.017263 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:41.017878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:41.023877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:41.024361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:41.024798 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:41.025484 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:41.026598 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:41.027036 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:41.165780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:41.173786 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-53a2a374-7c8f-4d00-a9fa-f12a3fbd6576 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1314 microversion: 2.1 time: 0.160452 Aug 10 11:24:41.174355 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 494/975] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:41 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:41.803005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:41.803622 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:41.810063 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:41.810596 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:41.811193 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:41.811771 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:41.812230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:41.812657 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:41.936428 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:41.937060 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:41.943459 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:41.943941 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:41.944374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:41.945097 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:41.945550 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:41.945973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:41.948329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:41.956643 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ff7fa9fd-602a-4aea-b4ad-d75e138cb8b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.157463 Aug 10 11:24:41.957229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 482/976] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:41 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:42.086861 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:42.095715 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-adf07052-2586-402e-9b4a-c4ab46e4546b tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1576 microversion: 2.1 time: 0.163553 Aug 10 11:24:42.096295 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 495/977] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:41 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:42.194944 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:42.195566 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:42.198553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:42.203663 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:42.204161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:42.204603 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:42.205315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:42.205777 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:42.206207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:42.341498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:42.349402 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-20afa692-667d-4e69-8e58-4927e02c3e1c tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1314 microversion: 2.1 time: 0.158132 Aug 10 11:24:42.349990 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 483/978] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:42 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:42.978732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:42.980152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:42.987690 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:42.988183 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:42.988615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:42.989518 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:42.990133 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:42.990560 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:43.117444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:43.118009 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:43.125380 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:43.125902 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:43.126339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:43.127086 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:43.127548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:43.127975 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:43.330221 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:43.337719 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-59e6b62a-006a-4408-a332-7d8bbfa3e886 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.364017 Aug 10 11:24:43.339071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 496/979] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:42 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:43.347347 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:43.354877 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02e829cd-4078-4b71-9471-2a3b99dea7db tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1576 microversion: 2.1 time: 0.241397 Aug 10 11:24:43.355437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 484/980] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:43 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:43.370792 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:43.371331 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:43.377353 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:43.377832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:43.378267 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:43.378992 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:43.379443 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:43.379893 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:43.550277 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:43.558586 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-da31de2e-1968-4ed5-9b30-0c6b04f7a2b7 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1314 microversion: 2.1 time: 0.192522 Aug 10 11:24:43.559285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 497/981] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:43 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:44.086335 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-2837a0c3-ce1e-4310-b802-68a3d71517cb req-c8ed2e6e-309a-4f48-a714-6981d1359cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eca8aa2-9f0a-476d-bc4c-08a3dcb02663", "name": "network-vif-plugged", "status": "completed", "tag": "bb357a6f-ec6a-47fe-8bbb-00540829977b"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:44.097167 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2837a0c3-ce1e-4310-b802-68a3d71517cb req-c8ed2e6e-309a-4f48-a714-6981d1359cf9 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.097653 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2837a0c3-ce1e-4310-b802-68a3d71517cb req-c8ed2e6e-309a-4f48-a714-6981d1359cf9 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.098456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2837a0c3-ce1e-4310-b802-68a3d71517cb req-c8ed2e6e-309a-4f48-a714-6981d1359cf9 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.120989 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-2837a0c3-ce1e-4310-b802-68a3d71517cb req-c8ed2e6e-309a-4f48-a714-6981d1359cf9 service nova] Creating event network-vif-plugged:bb357a6f-ec6a-47fe-8bbb-00540829977b for instance 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 on hv-cinder-85272 Aug 10 11:24:44.126821 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-2837a0c3-ce1e-4310-b802-68a3d71517cb req-c8ed2e6e-309a-4f48-a714-6981d1359cf9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044450 Aug 10 11:24:44.127428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 485/982] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:44.360087 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:44.360749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:44.367597 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.368346 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.369155 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.370415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.377824 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:44.378848 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:44.381939 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.382545 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.391683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.392227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.392673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.393670 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.399478 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.400277 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.631484 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:44.635378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:44.643855 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-146e1981-086a-4333-9b30-532b3dd933b5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1457 microversion: 2.1 time: 0.270715 Aug 10 11:24:44.644576 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 486/983] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:44 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1457 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:44.657787 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:44.657787 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:44.658164 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:44.658164 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:44.658344 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4168f57f-2992-4b26-92ec-cfb7fae07999 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.298082 Aug 10 11:24:44.660044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.660607 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.661309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.667826 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 498/984] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:44 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:44.676692 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.677682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.680850 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.812980 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-6ef0b1dd-2df3-4048-b291-359a3d87c862 req-54b69500-6a3d-46e4-8883-a6a6fad0bc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dcec59e-6d2c-4ed9-8e46-041d636a208a", "name": "network-vif-deleted", "tag": "14591c2b-ed56-404b-961a-a9175299d402"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:44.829307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-6ef0b1dd-2df3-4048-b291-359a3d87c862 req-54b69500-6a3d-46e4-8883-a6a6fad0bc77 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.830474 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-6ef0b1dd-2df3-4048-b291-359a3d87c862 req-54b69500-6a3d-46e4-8883-a6a6fad0bc77 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.831570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-6ef0b1dd-2df3-4048-b291-359a3d87c862 req-54b69500-6a3d-46e4-8883-a6a6fad0bc77 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.841810 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:44.848470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-6ef0b1dd-2df3-4048-b291-359a3d87c862 req-54b69500-6a3d-46e4-8883-a6a6fad0bc77 service nova] Creating event network-vif-deleted:14591c2b-ed56-404b-961a-a9175299d402 for instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a on hv-cinder-85272 Aug 10 11:24:44.853420 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3dc30118-0775-4a2a-b708-43861fddc62d tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1314 microversion: 2.1 time: 0.206298 Aug 10 11:24:44.854293 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-6ef0b1dd-2df3-4048-b291-359a3d87c862 req-54b69500-6a3d-46e4-8883-a6a6fad0bc77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044816 Aug 10 11:24:44.854941 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 499/985] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:24:44.862798 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 487/986] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:44 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:45.666839 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:45.667577 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:45.669628 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:45.670857 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:45.676928 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:45.677633 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:45.679700 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:45.679862 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:45.680190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:45.680898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:45.681673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:45.682821 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:45.683508 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:45.687967 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:45.688473 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:45.689131 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:45.689859 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:45.690322 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:45.690789 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:45.763598 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:45.771576 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0eabc090-d90b-475e-9233-d9920fe70acb tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1224 microversion: 2.1 time: 0.109904 Aug 10 11:24:45.772152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 500/987] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:45 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:45.858849 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:45.866625 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2bcf2d9f-72bf-4d5e-8c27-f5b018bc8d6f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.194204 Aug 10 11:24:45.867788 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 488/988] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:45 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:45.885920 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:45.886538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:45.892814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:45.893303 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:45.893744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:45.894458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:45.894955 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:45.895385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:46.030107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:46.037600 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a3124f06-ea13-439c-8153-fa2879de3839 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1314 microversion: 2.1 time: 0.158120 Aug 10 11:24:46.038165 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 501/989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:45 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:46.792091 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:46.792964 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:46.799555 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:46.800047 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:46.800580 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:46.801535 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:46.802011 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:46.802511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:46.837291 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:46.837772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:46.838296 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:46.838843 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lazy-loading 'fault' on Instance uuid 9dcec59e-6d2c-4ed9-8e46-041d636a208a {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:24:46.888341 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:46.889115 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:46.894685 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:46.895759 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:46.896248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:46.896683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:46.897501 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:46.897956 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:46.898379 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:46.903195 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d73788d3-07de-4533-8ceb-765fdd747a1c tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1229 microversion: 2.1 time: 0.115573 Aug 10 11:24:46.903763 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 489/990] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:46 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1229 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:47.058662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:47.059052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:47.059670 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:47.066150 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:47.066638 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:47.066811 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b05ac649-a2d9-4eb7-8e7c-10544e8a40d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.182810 Aug 10 11:24:47.067082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:47.067351 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 502/991] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:46 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:47.067936 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:47.068392 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:47.068818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:47.224820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:47.232744 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4d184ef0-c5a5-4614-8399-5985db9ac5b5 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1314 microversion: 2.1 time: 0.178167 Aug 10 11:24:47.233324 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 490/992] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:47 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:47.925501 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:47.926632 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:47.932457 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:47.932946 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:47.933385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:47.934088 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:47.934544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:47.935009 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:47.967166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:47.967536 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:47.967973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:47.968424 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lazy-loading 'fault' on Instance uuid 9dcec59e-6d2c-4ed9-8e46-041d636a208a {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:24:48.013700 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:48.021214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-754edf56-0632-4ca2-9928-2b2b252b503e tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 200 len: 1229 microversion: 2.1 time: 0.099810 Aug 10 11:24:48.021774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 503/993] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:47 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:48.087729 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:48.088823 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:48.095513 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:48.096079 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:48.096506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:48.097137 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:48.097592 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:48.098018 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:48.239870 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:48.247374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3bb0343f-960a-4413-b300-172311578c21 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.163504 Aug 10 11:24:48.247939 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 491/994] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:48 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:48.261243 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:48.262063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:48.268693 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:48.269184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:48.269618 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:48.270694 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:48.271151 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:48.271579 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:48.418172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:48.426286 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b657ba05-5bad-42ed-b734-d40c28c9b43a tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1497 microversion: 2.1 time: 0.175960 Aug 10 11:24:48.426890 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 504/995] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:48 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:48.813253 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-064cb753-888d-467b-9aff-2fe8889f5133 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:48.815651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-064cb753-888d-467b-9aff-2fe8889f5133 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:48.822334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064cb753-888d-467b-9aff-2fe8889f5133 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:48.823703 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064cb753-888d-467b-9aff-2fe8889f5133 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:48.824242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064cb753-888d-467b-9aff-2fe8889f5133 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:48.825056 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064cb753-888d-467b-9aff-2fe8889f5133 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:48.825520 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064cb753-888d-467b-9aff-2fe8889f5133 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:48.825948 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-064cb753-888d-467b-9aff-2fe8889f5133 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:48.878690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-064cb753-888d-467b-9aff-2fe8889f5133 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069291 Aug 10 11:24:48.879269 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 492/996] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 11:24:48 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:49.043108 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:49.043738 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 9dcec59e-6d2c-4ed9-8e46-041d636a208a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:49.051258 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.051743 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.052180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.052974 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.053429 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.053911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.068529 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] HTTP exception thrown: Instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a could not be found. Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Request method failure captured: Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a HTTP/1.1 Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85M_psov25eGkkzyQMHoyYW54vN061TczfwlTdEd2tI7nV2katGozn03Y_YaYa2b2M7JoUUvoImt9o4PHTF2k6102p3uSEC0tbNyoHmECmZi9m7aPtgvdqmynIF7lJgReV8KIHlQSW_do_7An07mt-0Qlddso2oLCRaka3gDMJyC6Uc Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:24:49.070252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 7ebc052a3cb6400a961c1b9d9bec83d6 Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a could not be found. Aug 10 11:24:49.071971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '9dcec59e-6d2c-4ed9-8e46-041d636a208a'} Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a could not be found. Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:24:49.072966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a could not be found. Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a could not be found. Aug 10 11:24:49.074546 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:49.075962 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Returning 404 to user: Instance 9dcec59e-6d2c-4ed9-8e46-041d636a208a could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:24:49.075962 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8bbeae46-8421-4826-8063-cce2ffd77af9 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a" status: 404 len: 111 microversion: 2.1 time: 0.033492 Aug 10 11:24:49.075962 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 505/997] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:49 2022] GET /compute/v2.1/servers/9dcec59e-6d2c-4ed9-8e46-041d636a208a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:49.206615 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:49.207965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:49.214957 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.215443 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.215880 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.216734 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.217189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.217618 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.249945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:24:49.259162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:49.260441 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:49.270099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.270697 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.271205 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.272336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.273165 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.273759 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.314430 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:24:49.341633 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b200d31e-be00-451c-8207-f1c773ab3548 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 204 len: 0 microversion: 2.20 time: 0.139437 Aug 10 11:24:49.345519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 493/998] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 10 11:24:49 2022] DELETE /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 11:24:49.349328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:49.350443 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:49.357674 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.358342 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.358856 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.359581 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.360076 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.360505 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.396581 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-99d1398b-d5c4-422d-854a-80bd3ab88b00 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 204 len: 0 microversion: 2.1 time: 0.142721 Aug 10 11:24:49.397258 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 506/999] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:24:49 2022] DELETE /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:24:49.403040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:49.403846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:49.409741 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.410227 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.410740 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.411406 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.411857 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.412276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.553092 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:49.561297 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-38fcdb4c-f97e-441c-9257-805063f87e8f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1570 microversion: 2.1 time: 0.217813 Aug 10 11:24:49.561968 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 494/1000] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:49 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1570 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:49.566649 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:49.567385 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:49.573792 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.574463 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.574885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.575589 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.576047 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.576471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.584500 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:49.593116 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:49.594673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:49.595898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4aaceb2e-ffe1-4f10-986e-7e27663eb83e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.197566 Aug 10 11:24:49.596455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 507/1001] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:24:49 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:24:49.601995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:49.602733 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:49.609995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.610633 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.611166 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.611865 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.612314 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.612736 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.643898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117919) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 11:24:49.714726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b1d21a8b-cb19-4629-9431-230304ba732b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "POST /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef/action" status: 202 len: 0 microversion: 2.1 time: 0.116281 Aug 10 11:24:49.715604 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 508/1002] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:24:49 2022] POST /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:24:49.717936 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:49.723359 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:49.723979 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:49.726778 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c0e94e2b-063d-48c1-ba5d-137b76b131bf tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1503 microversion: 2.1 time: 0.163326 Aug 10 11:24:49.727585 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 495/1003] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:49 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:49.731229 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.731443 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.731879 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.732932 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.733407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.733840 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.926207 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:49.939553 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5c0b380a-27f6-42ff-a2fd-f44a55970c26 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1578 microversion: 2.1 time: 0.219164 Aug 10 11:24:49.942665 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 509/1004] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:49 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:50.042146 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-659b66d2-79ee-49bb-9960-7c4a015eb405 req-d3018035-64cb-40d9-a22f-e7155bc5231d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210aa1a7-389f-4708-9b3a-e0919befdaef", "name": "network-vif-unplugged", "status": "completed", "tag": "0764a841-f90a-4927-a828-061ea8c8bf8c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:50.052443 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-659b66d2-79ee-49bb-9960-7c4a015eb405 req-d3018035-64cb-40d9-a22f-e7155bc5231d service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:50.053216 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-659b66d2-79ee-49bb-9960-7c4a015eb405 req-d3018035-64cb-40d9-a22f-e7155bc5231d service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:50.053793 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-659b66d2-79ee-49bb-9960-7c4a015eb405 req-d3018035-64cb-40d9-a22f-e7155bc5231d service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:50.067263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-659b66d2-79ee-49bb-9960-7c4a015eb405 req-d3018035-64cb-40d9-a22f-e7155bc5231d service nova] Creating event network-vif-unplugged:0764a841-f90a-4927-a828-061ea8c8bf8c for instance 210aa1a7-389f-4708-9b3a-e0919befdaef on hv-cinder-85272 Aug 10 11:24:50.072320 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-659b66d2-79ee-49bb-9960-7c4a015eb405 req-d3018035-64cb-40d9-a22f-e7155bc5231d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034327 Aug 10 11:24:50.073022 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 496/1005] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:50.618855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:50.619426 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:50.626037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:50.626517 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:50.626974 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:50.627696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:50.628141 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:50.628558 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:50.750266 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:50.751042 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:50.757170 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:50.757665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:50.758112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:50.758848 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:50.759306 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:50.760422 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:50.767373 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:50.776287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:50.778224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:50.779485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d62f555b-a3f9-4118-977e-8e60aead91eb tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.164697 Aug 10 11:24:50.780064 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 510/1006] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:24:50 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:24:50.912579 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:50.920668 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6ea0e3bc-4d02-4195-a304-2f972f46cef0 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1503 microversion: 2.1 time: 0.174985 Aug 10 11:24:50.921257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 497/1007] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:50 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:50.961744 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:50.962360 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:50.968730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:50.969218 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:50.969655 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:50.970551 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:50.971037 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:50.971469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:51.105441 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:51.112976 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bfb6ea0f-d43a-4eac-a2f7-1ca5031e3bb4 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1578 microversion: 2.1 time: 0.155012 Aug 10 11:24:51.113551 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 511/1008] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:50 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:51.802473 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:51.803493 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:51.811008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:51.811733 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:51.812423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:51.813229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:51.813802 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:51.814300 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:51.947336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:51.949631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:51.958875 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:51.959645 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:51.960074 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:51.960943 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:51.961671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:51.962248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:51.986471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:52.001770 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:52.004879 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:52.006853 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1cc4d289-5518-4d45-a04a-dbef6aa94a2f tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.207971 Aug 10 11:24:52.007922 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 498/1009] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:24:51 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:24:52.116019 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:52.123662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e8dd3bb0-18b7-48de-900c-2ab94afbab9f tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1503 microversion: 2.1 time: 0.181699 Aug 10 11:24:52.124246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 512/1010] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:51 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:52.142670 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:52.143382 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:52.149637 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:52.150212 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:52.151311 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:52.152096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:52.152652 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:52.153152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:52.292138 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:52.299920 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-95c50a4c-5449-4266-b202-08dbbd3fb5d9 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1578 microversion: 2.1 time: 0.161118 Aug 10 11:24:52.301172 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 499/1011] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:52 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:52.368584 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:52.369086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:52.375434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8e69fa0a-fe87-4eac-8977-1ce7690d1fb1 req-9ef2fbfa-e795-4786-b38d-adfed154008a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baed2b16-01ed-46c4-a01b-03f8ef8d6db3", "tag": "e81e1b57-8c3b-4a61-84eb-cefb848af8f3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:52.383012 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:52.383732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:52.384205 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:52.384911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:52.385875 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:52.386305 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:52.386540 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8e69fa0a-fe87-4eac-8977-1ce7690d1fb1 req-9ef2fbfa-e795-4786-b38d-adfed154008a service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:52.387052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8e69fa0a-fe87-4eac-8977-1ce7690d1fb1 req-9ef2fbfa-e795-4786-b38d-adfed154008a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:52.387483 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8e69fa0a-fe87-4eac-8977-1ce7690d1fb1 req-9ef2fbfa-e795-4786-b38d-adfed154008a service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:52.399820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8e69fa0a-fe87-4eac-8977-1ce7690d1fb1 req-9ef2fbfa-e795-4786-b38d-adfed154008a service nova] Creating event network-changed:e81e1b57-8c3b-4a61-84eb-cefb848af8f3 for instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 on hv-cinder-85272 Aug 10 11:24:52.405438 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8e69fa0a-fe87-4eac-8977-1ce7690d1fb1 req-9ef2fbfa-e795-4786-b38d-adfed154008a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033534 Aug 10 11:24:52.406262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 500/1012] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:52.413257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:24:52.416518 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:52.494921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-29eb4290-f309-4e06-a54d-468e434a5ec0 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "DELETE /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 204 len: 0 microversion: 2.1 time: 0.129319 Aug 10 11:24:52.495673 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 513/1013] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:24:52 2022] DELETE /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:24:52.504680 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:52.505444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:52.511654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:52.512140 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:52.512579 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:52.513276 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:52.513738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:52.514209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:52.665654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:52.674055 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b23e13d-9d82-4206-bf91-2f3d3f0e5805 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1574 microversion: 2.1 time: 0.173530 Aug 10 11:24:52.674649 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 501/1014] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:52 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:53.031206 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:53.031922 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:53.038509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.039048 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.039495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:53.040215 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.040677 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.041420 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:53.145054 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:53.145670 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:53.152694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.153176 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.153604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:53.154489 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.154998 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.155452 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:53.181369 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:53.191260 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:53.192889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:53.194154 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6f9cd270-a332-4a99-9ee4-6a122eb4ef12 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.168322 Aug 10 11:24:53.194832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 514/1015] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:24:53 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:24:53.303382 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:53.307563 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:53.313102 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb718d6a-ebdf-4819-a7a0-010c9f31d193 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1503 microversion: 2.1 time: 0.171879 Aug 10 11:24:53.313681 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 502/1016] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:53 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:53.321092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:53.322046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:53.329116 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.329691 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.330203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:53.331159 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.331627 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.332120 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:53.480806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:53.488687 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d240a510-ce3b-42b0-8e5c-74d11e043db1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1578 microversion: 2.1 time: 0.171352 Aug 10 11:24:53.489273 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 515/1017] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:53 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:53.704929 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:53.706061 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:53.719350 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.720719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.721498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:53.722899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.723734 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.724581 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:53.882982 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:53.891292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bbbc7ae5-ce14-4bfa-959d-8c14ce4bef38 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1574 microversion: 2.1 time: 0.193640 Aug 10 11:24:53.891884 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 503/1018] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:53 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:54.223385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:54.224130 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:54.231195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:54.231679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:54.232121 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:54.233081 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:54.233544 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:54.233973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:54.334748 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:54.336430 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:54.343707 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:54.344909 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:54.345594 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:54.346683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:54.347447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:54.348086 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:54.407938 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:54.418325 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:54.420310 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:54.422042 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-08e249cb-1f9a-4d56-9b4d-1ded5166647e tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1726 microversion: 2.20 time: 0.202542 Aug 10 11:24:54.423248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 516/1019] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:24:54 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:24:54.511287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:54.512238 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:54.518534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:54.519734 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:54.520173 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:54.520898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:54.521350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:54.521772 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:54.651814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:54.662008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f5444c8-94ba-4d5a-aeb5-eb9a88897f90 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1503 microversion: 2.1 time: 0.331185 Aug 10 11:24:54.678987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 504/1020] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:54 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:54.803126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:54.812276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a6dc9a23-7ce8-43ce-a64d-da8f2ee8d9d1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1520 microversion: 2.1 time: 0.306602 Aug 10 11:24:54.814095 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 517/1021] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:54 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:54.927525 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:54.927525 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:54.934405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:54.935193 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:54.935702 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:54.936528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:54.937206 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:54.938304 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.129290 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-ada3911f-3704-4a98-8986-cdcccf9d6190 req-4604959b-3e21-45da-a686-37a57aecd9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eca8aa2-9f0a-476d-bc4c-08a3dcb02663", "name": "network-vif-deleted", "tag": "bb357a6f-ec6a-47fe-8bbb-00540829977b"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:55.148324 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ada3911f-3704-4a98-8986-cdcccf9d6190 req-4604959b-3e21-45da-a686-37a57aecd9e7 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.149500 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ada3911f-3704-4a98-8986-cdcccf9d6190 req-4604959b-3e21-45da-a686-37a57aecd9e7 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.150224 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ada3911f-3704-4a98-8986-cdcccf9d6190 req-4604959b-3e21-45da-a686-37a57aecd9e7 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.220448 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-ada3911f-3704-4a98-8986-cdcccf9d6190 req-4604959b-3e21-45da-a686-37a57aecd9e7 service nova] Creating event network-vif-deleted:bb357a6f-ec6a-47fe-8bbb-00540829977b for instance 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 on hv-cinder-85272 Aug 10 11:24:55.241046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-ada3911f-3704-4a98-8986-cdcccf9d6190 req-4604959b-3e21-45da-a686-37a57aecd9e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119757 Aug 10 11:24:55.245768 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 518/1022] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:55.263299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-1c5fd095-5833-48f9-b09e-48cf5a036014 req-7a9ed9ba-877b-49a1-b763-a68695b81b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baed2b16-01ed-46c4-a01b-03f8ef8d6db3", "name": "network-vif-deleted", "tag": "e81e1b57-8c3b-4a61-84eb-cefb848af8f3"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:55.295528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1c5fd095-5833-48f9-b09e-48cf5a036014 req-7a9ed9ba-877b-49a1-b763-a68695b81b7f service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.298176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1c5fd095-5833-48f9-b09e-48cf5a036014 req-7a9ed9ba-877b-49a1-b763-a68695b81b7f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.301732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1c5fd095-5833-48f9-b09e-48cf5a036014 req-7a9ed9ba-877b-49a1-b763-a68695b81b7f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.337706 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-1c5fd095-5833-48f9-b09e-48cf5a036014 req-7a9ed9ba-877b-49a1-b763-a68695b81b7f service nova] Creating event network-vif-deleted:e81e1b57-8c3b-4a61-84eb-cefb848af8f3 for instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 on hv-cinder-85272 Aug 10 11:24:55.347445 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-1c5fd095-5833-48f9-b09e-48cf5a036014 req-7a9ed9ba-877b-49a1-b763-a68695b81b7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098542 Aug 10 11:24:55.348969 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 519/1023] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:55.366284 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:55.378698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c22e963c-3b19-4f14-af36-90a9c6511866 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1574 microversion: 2.1 time: 0.468833 Aug 10 11:24:55.383423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 505/1024] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:54 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1574 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:55.447382 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:55.449318 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:55.461109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.461613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.462053 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.462810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.463315 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.463747 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.558844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:55.567458 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:55.569316 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:55.570711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-18bdf589-6452-4c7a-b43d-efbb48636911 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1658 microversion: 2.20 time: 0.128286 Aug 10 11:24:55.571804 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 520/1025] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:24:55 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1658 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:24:55.684936 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:55.686060 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:55.705182 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.706683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.707591 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.709105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.709807 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.710618 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.757245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.757845 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.758291 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.758783 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lazy-loading 'fault' on Instance uuid 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:24:55.804629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91af9ceecb6f4bdc8411e73b47e91dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5056dc2a8244a0bc6d9a72147a0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:55.812015 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-afd5d836-b3c5-4837-8356-3237047efc72 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 200 len: 1304 microversion: 2.1 time: 0.131503 Aug 10 11:24:55.814710 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 506/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:55 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:55.835199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:55.835815 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:55.841984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.842505 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.843046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.843749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.844205 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.844630 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.051995 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:56.063563 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ac70089b-654c-4957-92af-173b273272c0 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.232560 Aug 10 11:24:56.064169 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 521/1027] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:55 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:56.403651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:56.405013 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:56.420129 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.421356 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.422302 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.423444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.429762 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.430704 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.477320 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.478309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.478885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.479392 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lazy-loading 'fault' on Instance uuid baed2b16-01ed-46c4-a01b-03f8ef8d6db3 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:24:56.532629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc052a3cb6400a961c1b9d9bec83d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79389800e0ea49d3b5abfbefe17960ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:56.540471 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5d6f7c31-d288-4850-848a-56812f9671a5 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 200 len: 1229 microversion: 2.1 time: 0.143698 Aug 10 11:24:56.542544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 507/1028] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:56 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 1229 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:56.597397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:56.598117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:56.605170 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.605733 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.606242 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.607168 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.607628 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.608063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.640255 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.640745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.641187 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.641644 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lazy-loading 'fault' on Instance uuid 00252e7d-b9e4-4476-a984-b33aa7286520 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:24:56.687933 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:56.704936 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:56.711435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f000354b524462bb66812138c6e4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a19aabba33c4e0ab7b3f2d9d58ec621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:56.713262 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ea961d45-43c1-4d2e-9e1b-9a856b079376 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 200 len: 1372 microversion: 2.20 time: 0.119707 Aug 10 11:24:56.713803 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 522/1029] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:24:56 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:24:56.833619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:56.834239 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] [instance: 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:56.840743 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.841588 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.842234 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.843295 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.843997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.845055 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.863880 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] HTTP exception thrown: Instance 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 could not be found. Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Request method failure captured: Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 HTTP/1.1 Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85VXSyn5VmsBmpfuwkyH8loL_w1p1S4MIKJUwQxAhmhB_H9_TQjOh8lOounZbJOAZn1CS5mX0LgK59_l8dsmHITe3RQENLeIu_zSLIo7NY2fvihXIw_AjEbzSa-bqiAyox_9pn9wmmf5J-NUuVzlbTrZrjsbmjJsCcjgOmGLN6RkApA Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 4b5056dc2a8244a0bc6d9a72147a0e7f Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesActionsTest-1719527733 Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:24:56.868398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b5056dc2a8244a0bc6d9a72147a0e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b5056dc2a8244a0bc6d9a72147a0e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b5056dc2a8244a0bc6d9a72147a0e7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b5056dc2a8244a0bc6d9a72147a0e7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesActionsTest-1719527733 Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4b5056dc2a8244a0bc6d9a72147a0e7f Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesActionsTest-1719527733 Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesActionsTest-1719527733-project Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 91af9ceecb6f4bdc8411e73b47e91dcd Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesActionsTest-1719527733-project Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 could not be found. Aug 10 11:24:56.870524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '7eca8aa2-9f0a-476d-bc4c-08a3dcb02663'} Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 could not be found. Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:24:56.872159 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 could not be found. Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 could not be found. Aug 10 11:24:56.874665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:56.877662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] Returning 404 to user: Instance 7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:24:56.877662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5dcb32bb-ec90-41bf-a58e-804e48430cc6 tempest-VolumesActionsTest-1719527733 tempest-VolumesActionsTest-1719527733-project] 10.222.0.49 "GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663" status: 404 len: 111 microversion: 2.1 time: 0.040006 Aug 10 11:24:56.877662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 508/1030] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:56 2022] GET /compute/v2.1/servers/7eca8aa2-9f0a-476d-bc4c-08a3dcb02663 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:57.088890 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:57.091468 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:57.098308 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:57.098937 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:57.099633 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:57.100681 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:57.101368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:57.102034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:57.271112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:57.278929 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4817b6e8-caea-4fb6-b497-4c93719df1fc tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.197230 Aug 10 11:24:57.279583 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 523/1031] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:57 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:57.562725 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:57.563349 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: baed2b16-01ed-46c4-a01b-03f8ef8d6db3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:57.566488 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5e9eac93-5303-4f28-9beb-937097fa7cb5 req-f4dcd920-a758-4231-bb0e-39c922414e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00252e7d-b9e4-4476-a984-b33aa7286520", "name": "network-vif-deleted", "tag": "70b8271c-1d70-4963-bf31-d732658386fc"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:57.570818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:57.571308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:57.572229 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:57.573450 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:57.573904 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:57.574333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:57.578309 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5e9eac93-5303-4f28-9beb-937097fa7cb5 req-f4dcd920-a758-4231-bb0e-39c922414e8e service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:57.578829 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5e9eac93-5303-4f28-9beb-937097fa7cb5 req-f4dcd920-a758-4231-bb0e-39c922414e8e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:57.579394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5e9eac93-5303-4f28-9beb-937097fa7cb5 req-f4dcd920-a758-4231-bb0e-39c922414e8e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:57.590489 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] HTTP exception thrown: Instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 could not be found. Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Request method failure captured: Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 HTTP/1.1 Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85M_psov25eGkkzyQMHoyYW54vN061TczfwlTdEd2tI7nV2katGozn03Y_YaYa2b2M7JoUUvoImt9o4PHTF2k6102p3uSEC0tbNyoHmECmZi9m7aPtgvdqmynIF7lJgReV8KIHlQSW_do_7An07mt-0Qlddso2oLCRaka3gDMJyC6Uc Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:24:57.592308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 7ebc052a3cb6400a961c1b9d9bec83d6 Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 could not be found. Aug 10 11:24:57.593720 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': 'baed2b16-01ed-46c4-a01b-03f8ef8d6db3'} Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 could not be found. Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:24:57.594534 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 could not be found. Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 could not be found. Aug 10 11:24:57.596219 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.597374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Returning 404 to user: Instance baed2b16-01ed-46c4-a01b-03f8ef8d6db3 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:24:57.597462 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5e9eac93-5303-4f28-9beb-937097fa7cb5 req-f4dcd920-a758-4231-bb0e-39c922414e8e service nova] Creating event network-vif-deleted:70b8271c-1d70-4963-bf31-d732658386fc for instance 00252e7d-b9e4-4476-a984-b33aa7286520 on hv-cinder-85272 Aug 10 11:24:57.597907 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9de09d44-f088-4ff3-a505-86a71e80bf61 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3" status: 404 len: 111 microversion: 2.1 time: 0.035530 Aug 10 11:24:57.597907 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 509/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:57 2022] GET /compute/v2.1/servers/baed2b16-01ed-46c4-a01b-03f8ef8d6db3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:57.603596 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5e9eac93-5303-4f28-9beb-937097fa7cb5 req-f4dcd920-a758-4231-bb0e-39c922414e8e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040654 Aug 10 11:24:57.604437 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 524/1033] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:24:57.736393 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:57.737903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:57.743890 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:57.744892 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:57.745350 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:57.746047 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:57.746498 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:57.746952 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:57.768329 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] HTTP exception thrown: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Request method failure captured: Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 HTTP/1.1 Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85MqnzrnppNEigvBcgpmydIaGJhjEIiJzNzuv9iwQlQZp9rp1W_ZWhTpOtazDSI0excz8v_ew1s-wRuIQjGf40kt90yfUNs2V4rinYZhFzy2s5_ixT_EQRBSpN_PcuDaJu7ZBKyyhlCDXbjQMXgSZpsy6lieW7Rig358dylsb9EXLmM Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:24:57.769895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 1f000354b524462bb66812138c6e4695 Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:24:57.771759 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '00252e7d-b9e4-4476-a984-b33aa7286520'} Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:24:57.772554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:24:57.773940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:57.775314 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Returning 404 to user: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:24:57.775314 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-70fab800-c013-4b0f-bde3-4905320d8c16 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 404 len: 111 microversion: 2.20 time: 0.038949 Aug 10 11:24:57.775314 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 510/1034] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:24:57 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:24:57.781409 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-37d302f6-0be1-43bc-8f10-8a5f55d685a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '.version_select at 0x7fccf8175d30>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:57.806354 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-37d302f6-0be1-43bc-8f10-8a5f55d685a8 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080956722" status: 204 len: 0 microversion: 2.20 time: 0.029536 Aug 10 11:24:57.807686 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 525/1035] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 10 11:24:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080956722 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 11:24:58.084596 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:58.085228 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:58.091975 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:58.092544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:58.093622 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:58.094436 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:58.094996 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:58.095434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:58.109461 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] HTTP exception thrown: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Request method failure captured: Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 HTTP/1.1 Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85M_psov25eGkkzyQMHoyYW54vN061TczfwlTdEd2tI7nV2katGozn03Y_YaYa2b2M7JoUUvoImt9o4PHTF2k6102p3uSEC0tbNyoHmECmZi9m7aPtgvdqmynIF7lJgReV8KIHlQSW_do_7An07mt-0Qlddso2oLCRaka3gDMJyC6Uc Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:24:58.111069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 7ebc052a3cb6400a961c1b9d9bec83d6 Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.112786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '628a87c3-fd0c-4dc9-928d-f3101ca70218'} Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:24:58.117208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.118740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.120344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Returning 404 to user: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:24:58.120344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8b056c2-0468-4ab6-bb53-4e826869ecc8 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "DELETE /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 404 len: 111 microversion: 2.1 time: 0.032029 Aug 10 11:24:58.120344 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 511/1036] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:24:58 2022] DELETE /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:58.121639 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:58.122407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] [instance: 628a87c3-fd0c-4dc9-928d-f3101ca70218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:58.129601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:58.130102 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:58.130656 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:58.131283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:58.131745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:58.132174 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:58.147766 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] HTTP exception thrown: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Request method failure captured: Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 HTTP/1.1 Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85M_psov25eGkkzyQMHoyYW54vN061TczfwlTdEd2tI7nV2katGozn03Y_YaYa2b2M7JoUUvoImt9o4PHTF2k6102p3uSEC0tbNyoHmECmZi9m7aPtgvdqmynIF7lJgReV8KIHlQSW_do_7An07mt-0Qlddso2oLCRaka3gDMJyC6Uc Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:24:58.149431 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79389800e0ea49d3b5abfbefe17960ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 79389800e0ea49d3b5abfbefe17960ac Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-1906905797 Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 7ebc052a3cb6400a961c1b9d9bec83d6 Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-1906905797-project Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.151234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '628a87c3-fd0c-4dc9-928d-f3101ca70218'} Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:24:58.152350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. Aug 10 11:24:58.153869 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:24:58.155981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Returning 404 to user: Instance 628a87c3-fd0c-4dc9-928d-f3101ca70218 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:24:58.155981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cafe6479-8054-41e2-9290-d95dfc8ab849 tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218" status: 404 len: 111 microversion: 2.1 time: 0.033439 Aug 10 11:24:58.155981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 526/1037] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:58 2022] GET /compute/v2.1/servers/628a87c3-fd0c-4dc9-928d-f3101ca70218 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:58.299873 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:58.300496 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:58.307281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:58.307862 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:58.308369 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:58.309105 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:58.309576 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:58.310008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:58.458764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:58.466923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1d08427e-06ef-422f-90b7-d1fae9afbe06 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.170862 Aug 10 11:24:58.470605 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 512/1038] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:58 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:59.487818 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:59.488412 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:59.494924 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.495400 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.495828 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:59.496519 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.496966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.497384 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:59.630243 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:59.638186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2a3c2799-fffb-4276-9a37-89462d211e7e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.154431 Aug 10 11:24:59.638775 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 527/1039] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:59 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:00.659743 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:00.660367 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:00.668035 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:00.668336 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:00.668772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:00.669495 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:00.669950 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:00.670381 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:00.810058 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:00.818323 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3edfb171-5402-4c22-a14a-ea90374e0824 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.162365 Aug 10 11:25:00.818937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 513/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:00 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:01.840847 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:01.841453 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:01.848272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:01.848785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:01.849219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:01.849918 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:01.850368 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:01.850819 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:01.988052 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:01.996247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-52d91556-e592-430e-90ef-67daad9033ce tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.159280 Aug 10 11:25:01.996820 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 528/1041] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:01 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:03.017661 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:03.018250 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:03.024461 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:03.024944 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:03.025410 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:03.026094 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:03.026546 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:03.026996 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:03.169116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:03.178711 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4d8ec528-b3ae-4d90-9770-b66154d93d24 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.164861 Aug 10 11:25:03.179284 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 514/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:03 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:04.199683 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:04.200304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:04.207422 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:04.207937 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:04.208415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:04.209312 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:04.209917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:04.210352 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:04.349742 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:04.365146 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7554d8f3-94c0-4913-973f-620899dc964a tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.168911 Aug 10 11:25:04.367156 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 529/1043] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:04 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:04.797547 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3f2cd66a-d112-4105-9456-9507391af6dd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] Calling method '.version_select at 0x7fccf8050160>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:04.824981 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3f2cd66a-d112-4105-9456-9507391af6dd tempest-TestVolumeBootPattern-1906905797 tempest-TestVolumeBootPattern-1906905797-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800106665" status: 202 len: 0 microversion: 2.1 time: 0.031875 Aug 10 11:25:04.825666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 515/1044] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 10 11:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800106665 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:25:05.117114 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:05.117774 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:05.129469 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:05.130287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:05.130994 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:05.134883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:05.136457 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:05.137117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:05.155251 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] HTTP exception thrown: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Request method failure captured: Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 HTTP/1.1 Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85MqnzrnppNEigvBcgpmydIaGJhjEIiJzNzuv9iwQlQZp9rp1W_ZWhTpOtazDSI0excz8v_ew1s-wRuIQjGf40kt90yfUNs2V4rinYZhFzy2s5_ixT_EQRBSpN_PcuDaJu7ZBKyyhlCDXbjQMXgSZpsy6lieW7Rig358dylsb9EXLmM Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:25:05.157668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 1f000354b524462bb66812138c6e4695 Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.159399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '00252e7d-b9e4-4476-a984-b33aa7286520'} Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:05.160662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.161915 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.165404 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Returning 404 to user: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:05.166745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-76bb4acf-843b-46e1-af32-0e9f36511ec6 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 404 len: 111 microversion: 2.20 time: 0.055577 Aug 10 11:25:05.167578 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 530/1045] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 10 11:25:05 2022] DELETE /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 11:25:05.181370 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:05.183067 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 00252e7d-b9e4-4476-a984-b33aa7286520] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:05.191238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:05.192086 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:05.192897 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:05.193828 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:05.194380 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:05.197956 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:05.216876 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] HTTP exception thrown: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Request method failure captured: Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 HTTP/1.1 Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85MqnzrnppNEigvBcgpmydIaGJhjEIiJzNzuv9iwQlQZp9rp1W_ZWhTpOtazDSI0excz8v_ew1s-wRuIQjGf40kt90yfUNs2V4rinYZhFzy2s5_ixT_EQRBSpN_PcuDaJu7ZBKyyhlCDXbjQMXgSZpsy6lieW7Rig358dylsb9EXLmM Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:25:05.218764 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 1f000354b524462bb66812138c6e4695 Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.220278 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '00252e7d-b9e4-4476-a984-b33aa7286520'} Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:05.221039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. Aug 10 11:25:05.222464 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:05.223701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Returning 404 to user: Instance 00252e7d-b9e4-4476-a984-b33aa7286520 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:05.223701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a86d4b4b-dc85-4205-a083-7256b458bb99 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520" status: 404 len: 111 microversion: 2.20 time: 0.045093 Aug 10 11:25:05.223701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 516/1046] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:25:05 2022] GET /compute/v2.1/servers/00252e7d-b9e4-4476-a984-b33aa7286520 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:25:05.393499 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:05.395007 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:05.398085 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:05.414921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:05.415407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:05.415840 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:05.416848 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:05.417440 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:05.419058 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:05.580369 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:05.590264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a654592e-8dfa-4dcd-baf8-4790246c2897 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.200934 Aug 10 11:25:05.591761 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 531/1047] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:05 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:05.902184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16f928a9-19c5-41a6-9a7f-a331dfe4cbf9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73eae59b-355c-43ba-b0fd-178f4cc879cf", "device": "/dev/sdb"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:05.907117 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16f928a9-19c5-41a6-9a7f-a331dfe4cbf9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:05.927066 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16f928a9-19c5-41a6-9a7f-a331dfe4cbf9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:05.927926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16f928a9-19c5-41a6-9a7f-a331dfe4cbf9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:05.930998 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16f928a9-19c5-41a6-9a7f-a331dfe4cbf9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:05.934412 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16f928a9-19c5-41a6-9a7f-a331dfe4cbf9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:05.935587 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16f928a9-19c5-41a6-9a7f-a331dfe4cbf9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:05.936668 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16f928a9-19c5-41a6-9a7f-a331dfe4cbf9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:06.365616 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16f928a9-19c5-41a6-9a7f-a331dfe4cbf9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "POST /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466955 Aug 10 11:25:06.366328 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 517/1048] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:25:05 2022] POST /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:06.442177 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:06.443196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:06.451565 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:06.452944 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:06.453966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:06.455726 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:06.456612 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:06.457242 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:06.475261 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] HTTP exception thrown: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Request method failure captured: Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 HTTP/1.1 Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85MqnzrnppNEigvBcgpmydIaGJhjEIiJzNzuv9iwQlQZp9rp1W_ZWhTpOtazDSI0excz8v_ew1s-wRuIQjGf40kt90yfUNs2V4rinYZhFzy2s5_ixT_EQRBSpN_PcuDaJu7ZBKyyhlCDXbjQMXgSZpsy6lieW7Rig358dylsb9EXLmM Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:25:06.482136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 1f000354b524462bb66812138c6e4695 Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.484620 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '2ee85970-24fd-4e03-9c90-460c66ab82e9'} Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:06.485886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.488716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.491172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Returning 404 to user: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:06.491172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5f0d25ab-56cb-4715-ac58-b6018e9c90c1 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 404 len: 111 microversion: 2.20 time: 0.053573 Aug 10 11:25:06.491172 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 532/1049] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 10 11:25:06 2022] DELETE /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:25:06.510779 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:06.510779 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] [instance: 2ee85970-24fd-4e03-9c90-460c66ab82e9] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:06.530514 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:06.531085 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:06.531558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:06.532631 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:06.535309 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:06.535786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:06.559520 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] HTTP exception thrown: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Request method failure captured: Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 HTTP/1.1 Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85MqnzrnppNEigvBcgpmydIaGJhjEIiJzNzuv9iwQlQZp9rp1W_ZWhTpOtazDSI0excz8v_ew1s-wRuIQjGf40kt90yfUNs2V4rinYZhFzy2s5_ixT_EQRBSpN_PcuDaJu7ZBKyyhlCDXbjQMXgSZpsy6lieW7Rig358dylsb9EXLmM Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:25:06.561264 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a19aabba33c4e0ab7b3f2d9d58ec621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 0a19aabba33c4e0ab7b3f2d9d58ec621 Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-778310063 Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 1f000354b524462bb66812138c6e4695 Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-778310063-project Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.562861 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '2ee85970-24fd-4e03-9c90-460c66ab82e9'} Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:06.563811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. Aug 10 11:25:06.565499 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:06.568285 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] Returning 404 to user: Instance 2ee85970-24fd-4e03-9c90-460c66ab82e9 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:06.568285 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b3d37591-a976-4734-b050-eb3183d4eeb0 tempest-AttachVolumeShelveTestJSON-778310063 tempest-AttachVolumeShelveTestJSON-778310063-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9" status: 404 len: 111 microversion: 2.20 time: 0.070761 Aug 10 11:25:06.568285 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 518/1050] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 11:25:06 2022] GET /compute/v2.1/servers/2ee85970-24fd-4e03-9c90-460c66ab82e9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:25:06.615688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:06.616382 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:06.625327 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:06.628482 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:06.631035 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:06.634548 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:06.635124 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:06.636083 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:06.720312 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:07.415509 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:07.431463 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a2276b6e-fc68-4381-8762-228d0da43ba3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.821164 Aug 10 11:25:07.433176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 533/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:06 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:08.459555 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:08.460781 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:08.472507 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:08.475838 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:08.476527 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:08.480323 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:08.481084 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:08.481695 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:09.178740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:09.195192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-72f4dffb-47c4-42be-8ed1-ad843c095466 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.740236 Aug 10 11:25:09.196480 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 519/1052] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:08 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:10.228825 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:10.231413 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:10.252653 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:10.255751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:10.256716 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:10.261613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:10.262353 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:10.263924 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:10.703671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:10.723299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-649da89b-23c0-48c1-84f2-8ee838534f93 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.499863 Aug 10 11:25:10.726534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 534/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:10 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:11.759407 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:11.760151 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:11.772293 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:11.773382 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:11.774030 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:11.775397 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:11.777074 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:11.777995 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:12.025102 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:12.036339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-79178c81-5672-4c5d-8593-632f4cea7a02 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.280760 Aug 10 11:25:12.037027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 520/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:11 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:13.059112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:13.059911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:13.079998 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:13.080911 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:13.081701 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:13.095592 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:13.096248 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:13.096806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:13.421051 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:13.431988 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3820a102-4a34-4e37-9ffb-b86ef5747dc3 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.378549 Aug 10 11:25:13.439562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 535/1055] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:13 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:14.463979 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:14.465891 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:14.473694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:14.475501 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:14.476268 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:14.476966 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:14.477941 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:14.478655 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:14.479405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:15.236392 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:15.247273 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0325e3ef-6922-41c5-9e97-b937b8482b1b tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.788566 Aug 10 11:25:15.250552 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 521/1056] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:14 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:15.937416 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-163669ac-788e-4f1b-8097-24a7db450ced tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Action: 'create', calling method: .version_select at 0x7fccf802edc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1778034956", "metadata": {"Type": "work"}}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-163669ac-788e-4f1b-8097-24a7db450ced tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Request method failure captured: Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 122 Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85WbNH7u79XsrnkcsxxPrJOqHh7zSfZgwu2CiRUo7fjN5eq0BRwqjKraWWHX8w3o8lNgwNg9H0mSP4e_wv64AXU4QViewY1yexnxulI5DpISXNcPt0KNfWf0JxWwWbLPwCzFccpsk7tCGsCgk5MkwZmSvSLkkH3z6mYz1oyHG3OUClw Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:25:15.970889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 8b3a6f2d9d3047089863dfa5570f1427 Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1778034956", "metadata": {"Type": "work"}}} Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: Aug 10 11:25:15.972764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1778034956', 'metadata': {'Type': 'work'}}}} Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise error Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:15.973888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 11:25:15.980276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 11:25:15.981582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 11:25:15.981582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.981582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-163669ac-788e-4f1b-8097-24a7db450ced tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:15.981582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-163669ac-788e-4f1b-8097-24a7db450ced tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.223853 Aug 10 11:25:15.981582 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 536/1057] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 10 11:25:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 226 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 11:25:15.985084 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11397850-3678-4882-bcd9-aa7b06d96459 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Action: 'create', calling method: .version_select at 0x7fccf81e3b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-141785135", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11397850-3678-4882-bcd9-aa7b06d96459 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Request method failure captured: Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 119 Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85WbNH7u79XsrnkcsxxPrJOqHh7zSfZgwu2CiRUo7fjN5eq0BRwqjKraWWHX8w3o8lNgwNg9H0mSP4e_wv64AXU4QViewY1yexnxulI5DpISXNcPt0KNfWf0JxWwWbLPwCzFccpsk7tCGsCgk5MkwZmSvSLkkH3z6mYz1oyHG3OUClw Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:25:15.990885 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 8b3a6f2d9d3047089863dfa5570f1427 Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-141785135", "metadata": {"Type": "work"}}} Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: Aug 10 11:25:15.992474 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-141785135', 'metadata': {'Type': 'work'}}}} Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise error Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi '0' Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:15.993506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 11:25:15.995308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 11:25:15.996533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 11:25:15.996533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:15.996533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11397850-3678-4882-bcd9-aa7b06d96459 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:15.996533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-11397850-3678-4882-bcd9-aa7b06d96459 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011246 Aug 10 11:25:16.004152 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-03c32e13-5cda-47c6-ad81-00523faab994 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Action: 'create', calling method: .version_select at 0x7fccf8366430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-139646939", "metadata": {"Type": "work"}}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:16.005977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 522/1058] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 10 11:25:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-03c32e13-5cda-47c6-ad81-00523faab994 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Request method failure captured: Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 118 Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85WbNH7u79XsrnkcsxxPrJOqHh7zSfZgwu2CiRUo7fjN5eq0BRwqjKraWWHX8w3o8lNgwNg9H0mSP4e_wv64AXU4QViewY1yexnxulI5DpISXNcPt0KNfWf0JxWwWbLPwCzFccpsk7tCGsCgk5MkwZmSvSLkkH3z6mYz1oyHG3OUClw Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:25:16.008588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 8b3a6f2d9d3047089863dfa5570f1427 Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-139646939", "metadata": {"Type": "work"}}} Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: Aug 10 11:25:16.010856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-139646939', 'metadata': {'Type': 'work'}}}} Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise error Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi '' Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:16.011855 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 11:25:16.013585 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 11:25:16.015055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 11:25:16.015055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.015055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-03c32e13-5cda-47c6-ad81-00523faab994 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:16.015055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-03c32e13-5cda-47c6-ad81-00523faab994 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009854 Aug 10 11:25:16.021819 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dd2f850e-bff5-4be5-aa53-6c45b6c2cba4 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Calling method '.version_select at 0x7fccf81a5940>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:16.030308 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 537/1059] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 10 11:25:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:25:16.066814 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-dd2f850e-bff5-4be5-aa53-6c45b6c2cba4 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] HTTP exception thrown: Volume tempest-invalid-523595220 could not be found. Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dd2f850e-bff5-4be5-aa53-6c45b6c2cba4 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Request method failure captured: Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-523595220 HTTP/1.1 Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85WbNH7u79XsrnkcsxxPrJOqHh7zSfZgwu2CiRUo7fjN5eq0BRwqjKraWWHX8w3o8lNgwNg9H0mSP4e_wv64AXU4QViewY1yexnxulI5DpISXNcPt0KNfWf0JxWwWbLPwCzFccpsk7tCGsCgk5MkwZmSvSLkkH3z6mYz1oyHG3OUClw Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:25:16.068826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 8b3a6f2d9d3047089863dfa5570f1427 Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Volume tempest-invalid-523595220 could not be found. Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': 'tempest-invalid-523595220'} Aug 10 11:25:16.070365 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-523595220 could not be found. (HTTP 404) (Request-ID: req-ed6c5e26-71ad-4847-9ddf-ed68fb41eb1b) Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.071308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:25:16.072673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-523595220 could not be found. Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:25:16.074208 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-523595220 could not be found. Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-523595220 could not be found. Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dd2f850e-bff5-4be5-aa53-6c45b6c2cba4 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Returning 404 to user: Volume tempest-invalid-523595220 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:16.075754 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dd2f850e-bff5-4be5-aa53-6c45b6c2cba4 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-523595220" status: 404 len: 98 microversion: 2.1 time: 0.052308 Aug 10 11:25:16.083657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cdeec899-d3ed-4e91-88b1-454156cde44a tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003977 Aug 10 11:25:16.088367 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 523/1060] 10.222.0.49 () {58 vars in 1215 bytes} [Wed Aug 10 11:25:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-523595220 => generated 98 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 11:25:16.090785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 538/1061] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 10 11:25:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 11:25:16.094152 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-df193252-1bfb-4645-8bf1-67761228d9f9 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004064 Aug 10 11:25:16.105394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af174ea3-72c6-4202-855f-0e2626cca486 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Calling method '.version_select at 0x7fccf8175790>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:16.110687 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 524/1062] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 10 11:25:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 11:25:16.149637 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-af174ea3-72c6-4202-855f-0e2626cca486 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] HTTP exception thrown: Volume e610259b-4ef7-4984-90dc-6d035a8f6a48 could not be found. Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af174ea3-72c6-4202-855f-0e2626cca486 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Request method failure captured: Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/os-volumes/e610259b-4ef7-4984-90dc-6d035a8f6a48 HTTP/1.1 Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85WbNH7u79XsrnkcsxxPrJOqHh7zSfZgwu2CiRUo7fjN5eq0BRwqjKraWWHX8w3o8lNgwNg9H0mSP4e_wv64AXU4QViewY1yexnxulI5DpISXNcPt0KNfWf0JxWwWbLPwCzFccpsk7tCGsCgk5MkwZmSvSLkkH3z6mYz1oyHG3OUClw Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:25:16.151713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 8b3a6f2d9d3047089863dfa5570f1427 Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Volume e610259b-4ef7-4984-90dc-6d035a8f6a48 could not be found. Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': 'e610259b-4ef7-4984-90dc-6d035a8f6a48'} Aug 10 11:25:16.153452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e610259b-4ef7-4984-90dc-6d035a8f6a48 could not be found. (HTTP 404) (Request-ID: req-6c8a72a1-ced7-4e60-ab4a-f89e3b45e64d) Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.155749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:25:16.159570 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e610259b-4ef7-4984-90dc-6d035a8f6a48 could not be found. Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 11:25:16.165004 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e610259b-4ef7-4984-90dc-6d035a8f6a48 could not be found. Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e610259b-4ef7-4984-90dc-6d035a8f6a48 could not be found. Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af174ea3-72c6-4202-855f-0e2626cca486 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Returning 404 to user: Volume e610259b-4ef7-4984-90dc-6d035a8f6a48 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-af174ea3-72c6-4202-855f-0e2626cca486 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/e610259b-4ef7-4984-90dc-6d035a8f6a48" status: 404 len: 109 microversion: 2.1 time: 0.052326 Aug 10 11:25:16.170881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 539/1063] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 11:25:16 2022] DELETE /compute/v2.1/os-volumes/e610259b-4ef7-4984-90dc-6d035a8f6a48 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:25:16.177057 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8da2016e-dce8-40ff-ba8a-4afc7e4f6ff7 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Calling method '.version_select at 0x7fccf80e2ca0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:16.205493 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-8da2016e-dce8-40ff-ba8a-4afc7e4f6ff7 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] HTTP exception thrown: Volume 7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b could not be found. Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8da2016e-dce8-40ff-ba8a-4afc7e4f6ff7 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Request method failure captured: Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b HTTP/1.1 Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85WbNH7u79XsrnkcsxxPrJOqHh7zSfZgwu2CiRUo7fjN5eq0BRwqjKraWWHX8w3o8lNgwNg9H0mSP4e_wv64AXU4QViewY1yexnxulI5DpISXNcPt0KNfWf0JxWwWbLPwCzFccpsk7tCGsCgk5MkwZmSvSLkkH3z6mYz1oyHG3OUClw Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:25:16.208119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_279b499cb7b3458c84143ab7f18cab56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 279b499cb7b3458c84143ab7f18cab56 Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-717442966 Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 8b3a6f2d9d3047089863dfa5570f1427 Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-717442966-project Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Volume 7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b could not be found. Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b'} Aug 10 11:25:16.210139 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b could not be found. (HTTP 404) (Request-ID: req-21c033c1-c85a-4c7e-845f-0a0a07778f36) Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.211666 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:25:16.212915 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b could not be found. Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:25:16.214209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b could not be found. Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b could not be found. Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8da2016e-dce8-40ff-ba8a-4afc7e4f6ff7 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] Returning 404 to user: Volume 7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:16.216447 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8da2016e-dce8-40ff-ba8a-4afc7e4f6ff7 tempest-VolumesNegativeTest-717442966 tempest-VolumesNegativeTest-717442966-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b" status: 404 len: 109 microversion: 2.1 time: 0.049740 Aug 10 11:25:16.219604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 525/1064] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 11:25:16 2022] GET /compute/v2.1/os-volumes/7d2eeabe-662c-43ef-90e4-00dc9b4c3b5b => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:25:16.269264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:16.270040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:16.288996 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:16.293497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:16.294337 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:16.296336 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:16.297512 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:16.298727 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:16.624239 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:16.636534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-047112db-3675-4386-9932-bd8c16554169 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.367935 Aug 10 11:25:16.637162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 540/1065] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:16 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:17.667038 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:17.669806 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:17.702634 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:17.705090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:17.706845 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:17.708437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:17.710319 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:17.712488 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:17.756821 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:17.893554 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-2eec64bb-92fd-4a2a-a9fd-40254c540636 req-bdecffb0-aeb2-4f10-bb5f-c212fd25626f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210aa1a7-389f-4708-9b3a-e0919befdaef", "name": "network-vif-plugged", "status": "completed", "tag": "0764a841-f90a-4927-a828-061ea8c8bf8c"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:17.917483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-2eec64bb-92fd-4a2a-a9fd-40254c540636 req-bdecffb0-aeb2-4f10-bb5f-c212fd25626f service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:17.924878 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-2eec64bb-92fd-4a2a-a9fd-40254c540636 req-bdecffb0-aeb2-4f10-bb5f-c212fd25626f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:17.925668 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-2eec64bb-92fd-4a2a-a9fd-40254c540636 req-bdecffb0-aeb2-4f10-bb5f-c212fd25626f service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:17.970773 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-2eec64bb-92fd-4a2a-a9fd-40254c540636 req-bdecffb0-aeb2-4f10-bb5f-c212fd25626f service nova] Creating event network-vif-plugged:0764a841-f90a-4927-a828-061ea8c8bf8c for instance 210aa1a7-389f-4708-9b3a-e0919befdaef on hv-cinder-85272 Aug 10 11:25:17.984339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-2eec64bb-92fd-4a2a-a9fd-40254c540636 req-bdecffb0-aeb2-4f10-bb5f-c212fd25626f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095516 Aug 10 11:25:17.987323 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 541/1066] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:25:17.989945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:18.000093 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-303c5e20-5d2c-4ee1-8db9-55d7ba701cd7 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.343306 Aug 10 11:25:18.000965 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 526/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:17 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:19.037901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:19.039344 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:19.048724 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:19.049810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:19.050272 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:19.051304 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:19.051779 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:19.052212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:19.253688 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:19.263898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-570bfbfd-a717-4d50-8a73-353f2c147170 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.230786 Aug 10 11:25:19.279844 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 542/1068] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:19 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:20.286069 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:20.286771 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:20.297417 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:20.298235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:20.298739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:20.299761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:20.299893 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:20.300291 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:20.607397 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:20.620456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-072b520c-5ac3-4f10-a135-7c551a873f86 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1576 microversion: 2.1 time: 0.337807 Aug 10 11:25:20.631537 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 527/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:20 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1576 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:21.651507 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:21.653126 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:21.661184 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:21.662005 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:21.663108 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:21.664265 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:21.664946 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:21.665413 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:21.864526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:21.877454 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-212f170c-265a-4ae6-87e9-15ad61015a17 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1563 microversion: 2.1 time: 0.233157 Aug 10 11:25:21.893771 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 543/1070] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:21 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:35.537546 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:35.538033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:35.540493 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=5 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:35.541145 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=8 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:35.547665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:35.548820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:35.549257 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:35.549962 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:35.550416 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:35.550864 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:35.633578 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lazy-loading 'services' on Instance uuid cbefd723-b07e-47f2-8756-1ac1c062d310 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:25:35.712445 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c2c0d159-c638-489d-8091-a156543b14e7 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310/os-volume_attachments/73eae59b-355c-43ba-b0fd-178f4cc879cf" status: 202 len: 0 microversion: 2.1 time: 0.178624 Aug 10 11:25:35.713398 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 528/1071] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:25:35 2022] DELETE /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310/os-volume_attachments/73eae59b-355c-43ba-b0fd-178f4cc879cf => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:25:36.473526 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1758254061", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:36.481321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=17 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:36.481970 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=34 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:36.529966 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] validate_networks() for None {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:25:36.851271 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:36.852457 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:36.858956 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.859676 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.860276 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:36.861149 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.861770 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.862384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:36.878749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:25:36.879177 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:25:36.879651 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:25:36.880255 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:25:36.880963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:25:36.891732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.892214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.892647 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:36.893021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:25:36.893532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.893996 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.894421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:36.912711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Getting quotas for project c56abb478c1f44508d3f22ab53b0af8c. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:25:36.917146 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Getting quotas for user de84a91a0f6e4a58813a48a3bc189f9a and project c56abb478c1f44508d3f22ab53b0af8c. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:25:36.930797 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:25:36.933945 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:25:36.972993 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-48c9a7f6-3fe4-4962-9c24-ce1c612ac253 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 204 len: 0 microversion: 2.1 time: 0.126691 Aug 10 11:25:36.973615 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 529/1072] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:25:36 2022] DELETE /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:25:36.981942 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-eaa15f6a-3d80-4265-a1a0-6fc4d85f4b7a tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512275 Aug 10 11:25:36.990019 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 544/1073] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:25:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:25:36.998693 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:36.999658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:37.000455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e916df0d-c2dc-4d8d-8f6a-3c8ecfafed54 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:37.001360 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e916df0d-c2dc-4d8d-8f6a-3c8ecfafed54 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:37.009072 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:37.009780 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:37.011424 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:37.012199 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:37.012742 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:37.013238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:37.068296 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e916df0d-c2dc-4d8d-8f6a-3c8ecfafed54 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:37.079269 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e916df0d-c2dc-4d8d-8f6a-3c8ecfafed54 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1215 microversion: 2.1 time: 0.087633 Aug 10 11:25:37.080292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 545/1074] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:36 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:37.191747 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:37.201940 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d5b9380-8ee3-457f-97ba-d25e06ca6d92 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1513 microversion: 2.1 time: 0.223195 Aug 10 11:25:37.202853 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 530/1075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:36 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:38.100387 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:38.101014 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:38.107689 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:38.108177 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:38.108615 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:38.109319 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:38.109782 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:38.110212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:38.177812 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:38.185335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-66701d0f-7aa1-4471-a6e1-e612a0087fa7 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1219 microversion: 2.1 time: 0.089488 Aug 10 11:25:38.193079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 546/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:38 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:38.223549 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:38.224262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:38.231728 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:38.235292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:38.235292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:38.235292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:38.235292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:38.235745 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:38.379127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:38.391201 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a0c744e9-439f-49fe-a605-402ceddc180c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1513 microversion: 2.1 time: 0.171521 Aug 10 11:25:38.391781 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 531/1077] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:38 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:39.206790 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:39.207341 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:39.214183 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.214695 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.215133 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.215816 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.216263 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.216679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.282675 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:39.290144 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-017381a5-ccea-4f60-8c80-63687d5c4ff3 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1267 microversion: 2.1 time: 0.087551 Aug 10 11:25:39.290756 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 547/1078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:39 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:39.412887 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:39.414166 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:39.422558 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.423351 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.424453 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.425600 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.427382 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.428154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.739511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:39.747973 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f823aef7-2355-488f-bbc0-5ee0b92af702 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 200 len: 1513 microversion: 2.1 time: 0.339142 Aug 10 11:25:39.748654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 532/1079] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:39 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 1513 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:39.997454 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-b8757ba4-31d9-40ff-86b4-86d8712aab45 req-1b3224b1-f6a0-42fc-ba25-12eda437cd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbefd723-b07e-47f2-8756-1ac1c062d310", "name": "network-vif-deleted", "tag": "7b51d0a3-a223-437f-81c1-4e7ba33fe27e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:40.008806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b8757ba4-31d9-40ff-86b4-86d8712aab45 req-1b3224b1-f6a0-42fc-ba25-12eda437cd92 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.009285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b8757ba4-31d9-40ff-86b4-86d8712aab45 req-1b3224b1-f6a0-42fc-ba25-12eda437cd92 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.009720 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b8757ba4-31d9-40ff-86b4-86d8712aab45 req-1b3224b1-f6a0-42fc-ba25-12eda437cd92 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.022929 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-b8757ba4-31d9-40ff-86b4-86d8712aab45 req-1b3224b1-f6a0-42fc-ba25-12eda437cd92 service nova] Creating event network-vif-deleted:7b51d0a3-a223-437f-81c1-4e7ba33fe27e for instance cbefd723-b07e-47f2-8756-1ac1c062d310 on hv-cinder-85272 Aug 10 11:25:40.029149 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-b8757ba4-31d9-40ff-86b4-86d8712aab45 req-1b3224b1-f6a0-42fc-ba25-12eda437cd92 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035875 Aug 10 11:25:40.031122 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 548/1080] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:40.311818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:40.312926 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:40.320003 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.320585 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.321027 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.321730 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.323455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.323455 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.389042 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:40.397714 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-99b3ff43-5d34-4bdd-bb57-e93e96ea67e9 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1273 microversion: 2.1 time: 0.090042 Aug 10 11:25:40.398425 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 533/1081] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:40 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:40.773344 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:40.774968 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: cbefd723-b07e-47f2-8756-1ac1c062d310] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:40.783795 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.784300 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.784745 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.785456 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.785939 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.786696 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.813382 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] HTTP exception thrown: Instance cbefd723-b07e-47f2-8756-1ac1c062d310 could not be found. Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Request method failure captured: Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 HTTP/1.1 Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85ViMPl9DQPM_A_Rd0Or_xhGyqYhsmkJrMAxeI2g8FUrW0SFFXIQuwNOBywbzjtwitoIgQn4ovPnvTAEdBywLvGlQ-VCuWSnk3AjCEdKmegnrt2IPggPtSV15XQP_-7Rc3DoCbRq5Ack3D2FGuWgeUMJyuJ45lwfMUjxK4CTc_n2e70 Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 50beb48049264dfe8b6a75937c1041fe Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotTestJSON-937598806 Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:25:40.815246 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/50beb48049264dfe8b6a75937c1041fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50beb48049264dfe8b6a75937c1041fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50beb48049264dfe8b6a75937c1041fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_50beb48049264dfe8b6a75937c1041fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotTestJSON-937598806 Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 50beb48049264dfe8b6a75937c1041fe Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-937598806 Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotTestJSON-937598806-project Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 3de54cdce7634d7d9519722cfb67d45e Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotTestJSON-937598806-project Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance cbefd723-b07e-47f2-8756-1ac1c062d310 could not be found. Aug 10 11:25:40.817284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': 'cbefd723-b07e-47f2-8756-1ac1c062d310'} Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbefd723-b07e-47f2-8756-1ac1c062d310 could not be found. Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:25:40.818415 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbefd723-b07e-47f2-8756-1ac1c062d310 could not be found. Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbefd723-b07e-47f2-8756-1ac1c062d310 could not be found. Aug 10 11:25:40.820421 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:25:40.822054 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Returning 404 to user: Instance cbefd723-b07e-47f2-8756-1ac1c062d310 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:25:40.822054 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fb518137-6273-47e8-8c0b-a16fb13da84b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310" status: 404 len: 111 microversion: 2.1 time: 0.052678 Aug 10 11:25:40.822054 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 549/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:40 2022] GET /compute/v2.1/servers/cbefd723-b07e-47f2-8756-1ac1c062d310 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:25:41.419598 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:41.420275 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:41.426883 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:41.427387 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:41.427829 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:41.428549 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:41.429011 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:41.429444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:41.521917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-593fde37-7f94-4e07-be0d-96107c11127d req-bfcc7af9-b937-4c7e-bffc-88681965e304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0abb581b-62c0-4d1d-a669-5002359e0f10", "tag": "4f97f144-67c4-4e59-a9fe-64d13e2059ba"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:41.532111 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-593fde37-7f94-4e07-be0d-96107c11127d req-bfcc7af9-b937-4c7e-bffc-88681965e304 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:41.532736 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-593fde37-7f94-4e07-be0d-96107c11127d req-bfcc7af9-b937-4c7e-bffc-88681965e304 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:41.533268 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-593fde37-7f94-4e07-be0d-96107c11127d req-bfcc7af9-b937-4c7e-bffc-88681965e304 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:41.545721 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-593fde37-7f94-4e07-be0d-96107c11127d req-bfcc7af9-b937-4c7e-bffc-88681965e304 service nova] Creating event network-changed:4f97f144-67c4-4e59-a9fe-64d13e2059ba for instance 0abb581b-62c0-4d1d-a669-5002359e0f10 on hv-cinder-85272 Aug 10 11:25:41.550750 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-593fde37-7f94-4e07-be0d-96107c11127d req-bfcc7af9-b937-4c7e-bffc-88681965e304 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032839 Aug 10 11:25:41.552008 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 550/1083] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:25:41.571700 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:41.579954 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc3e3862-4f3e-48a1-b465-50a51aee4caa tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.164385 Aug 10 11:25:41.580525 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 534/1084] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:41 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:42.601168 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:42.601860 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:42.608557 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:42.609039 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:42.609470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:42.610161 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:42.610638 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:42.611069 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:42.749939 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:42.757449 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-22db87fd-f195-4a19-876a-98f694c3e798 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.160405 Aug 10 11:25:42.758018 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 551/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:42 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:43.779696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:43.780313 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:43.786945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:43.787431 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:43.787866 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:43.788589 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:43.789044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:43.789468 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:43.932918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:43.941755 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f46d2739-340b-4f95-b50e-a17ea93494ba tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.166636 Aug 10 11:25:43.942348 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 535/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:43 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:44.966269 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:44.967135 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:44.974202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.974730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.975425 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:44.976698 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.978483 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.979910 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:45.156559 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:45.164531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-01a95ad3-c5ac-4e01-b7b7-e27f4f26a7ca tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.202608 Aug 10 11:25:45.179316 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 552/1087] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:44 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:46.185294 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:46.185837 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:46.192714 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:46.193206 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:46.193644 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:46.196184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:46.196184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:46.196184 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:46.334739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:46.343635 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f44fa5a4-82d8-4841-8802-b5133bc96b6b tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.162286 Aug 10 11:25:46.344218 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 536/1088] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:46 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:47.365016 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:47.365628 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:47.368133 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:47.368834 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=8 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:47.375631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.376124 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.376567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.377279 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.377738 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.378169 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.520679 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:47.528188 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1aee7c8b-ea7b-40a2-98d0-3e96b0a8e9ac tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.167147 Aug 10 11:25:47.528749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 553/1089] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:47 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:48.548962 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:48.549519 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:48.556554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.557048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.557490 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.558192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.558685 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.559119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.697895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:48.707132 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-140b7292-f539-436a-a041-4f769c4c3105 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.162045 Aug 10 11:25:48.707715 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 537/1090] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:48 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:49.728298 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:49.728930 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:49.735853 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.736350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.736788 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:49.737498 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.737954 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.738383 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:49.892188 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:49.904484 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9a5df062-3244-42fc-b1cc-02edd1006009 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.180515 Aug 10 11:25:49.905449 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 554/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:49 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:50.936565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:50.937361 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:50.944025 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:50.944514 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:50.944945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:50.945644 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:50.946096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:50.946524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:51.086772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:51.094715 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1504b18d-5eaa-469b-9589-fd0f585fe1b0 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.162698 Aug 10 11:25:51.095289 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 538/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:50 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:52.114903 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:52.115521 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:52.122090 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:52.122593 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:52.123033 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:52.123752 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:52.124211 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:52.124631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:52.288249 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:52.296562 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-15db7c22-0a1c-4695-8cde-bbc74b134a88 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.185297 Aug 10 11:25:52.297351 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 555/1093] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:52 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:53.320288 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:53.320902 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:53.327794 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.328276 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.328718 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.329554 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.330269 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.330716 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.481436 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:53.490066 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a9c3921e-0d07-4e83-a78b-920b35c41b55 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.173515 Aug 10 11:25:53.490675 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 539/1094] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:53 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:54.512732 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:54.513378 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:54.520428 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.520925 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.521360 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.522079 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.522532 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.522986 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.667714 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:54.675396 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-59606941-8eff-461f-9bfe-c35f3a382c77 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.167136 Aug 10 11:25:54.675981 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 556/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:54 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:55.702108 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:55.702774 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:55.709933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.710423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.710888 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.711597 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.712052 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.712478 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.852222 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:55.861183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fb8e6be2-a819-4cdf-a960-4a52babad730 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.163381 Aug 10 11:25:55.861786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 540/1096] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:55 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:56.010816 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1890984435", "imageRef": "ab1ea23b-b626-46d4-a9c8-c4df6588e3ed", "flavorRef": "452", "networks": [{"uuid": "afd201d7-bb2d-43af-b661-037d5589921f"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:56.065276 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] validate_networks() for [('afd201d7-bb2d-43af-b661-037d5589921f', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:25:56.602452 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:25:56.602909 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:25:56.603389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:25:56.603856 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:25:56.604269 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:25:56.614831 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:56.615325 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:56.615763 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:56.616567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:56.617024 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:56.617450 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:56.635948 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Getting quotas for project 50beb48049264dfe8b6a75937c1041fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:25:56.640393 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Getting quotas for user 3de54cdce7634d7d9519722cfb67d45e and project 50beb48049264dfe8b6a75937c1041fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:25:56.651880 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:25:56.654129 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab1ea23b-b626-46d4-a9c8-c4df6588e3ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:25:56.702693 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-461bba80-8580-46c6-a4b8-dcf02a234c76 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696073 Aug 10 11:25:56.703353 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 557/1097] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:25:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:25:56.715693 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf92ab6b-1b36-4e8e-a160-4fc20eb4ef45 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:56.716348 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf92ab6b-1b36-4e8e-a160-4fc20eb4ef45 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:56.783148 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cf92ab6b-1b36-4e8e-a160-4fc20eb4ef45 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:56.790235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf92ab6b-1b36-4e8e-a160-4fc20eb4ef45 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1219 microversion: 2.1 time: 0.078492 Aug 10 11:25:56.790933 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 541/1098] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:56 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:56.882813 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:56.883601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:56.891105 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:56.891698 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:56.892494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:56.893230 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:56.893692 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:56.894153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.047830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:57.057531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f211496b-97d7-4e3e-b530-a7005daf328d tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.178442 Aug 10 11:25:57.058617 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 558/1099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:56 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:57.138668 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-10f6bfe3-402c-4481-8d15-d5d566180248 req-e479d68a-7538-4e88-863a-693bf97cadaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0abb581b-62c0-4d1d-a669-5002359e0f10", "name": "network-vif-plugged", "status": "completed", "tag": "4f97f144-67c4-4e59-a9fe-64d13e2059ba"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:57.151189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-10f6bfe3-402c-4481-8d15-d5d566180248 req-e479d68a-7538-4e88-863a-693bf97cadaf service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.151714 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-10f6bfe3-402c-4481-8d15-d5d566180248 req-e479d68a-7538-4e88-863a-693bf97cadaf service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.152334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-10f6bfe3-402c-4481-8d15-d5d566180248 req-e479d68a-7538-4e88-863a-693bf97cadaf service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.163533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-10f6bfe3-402c-4481-8d15-d5d566180248 req-e479d68a-7538-4e88-863a-693bf97cadaf service nova] Creating event network-vif-plugged:4f97f144-67c4-4e59-a9fe-64d13e2059ba for instance 0abb581b-62c0-4d1d-a669-5002359e0f10 on hv-cinder-85272 Aug 10 11:25:57.168665 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-10f6bfe3-402c-4481-8d15-d5d566180248 req-e479d68a-7538-4e88-863a-693bf97cadaf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034359 Aug 10 11:25:57.169258 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 542/1100] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:25:57.813318 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:57.814219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:57.821681 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.822257 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.822826 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.824235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.824762 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.825514 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.908901 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:57.916817 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3bc53598-ae26-4d98-8db1-016d11b864ea tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1271 microversion: 2.1 time: 0.109202 Aug 10 11:25:57.918270 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 559/1101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:57 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:58.080553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:58.081266 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:58.087853 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.088268 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.088705 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.090001 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.090462 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.090920 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.230606 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:58.234608 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:58.239570 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb42fc25-d8d5-49fa-9d1c-6ad316f7feea tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.164019 Aug 10 11:25:58.240140 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 543/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:58 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:58.939097 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:58.939534 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:58.953919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.955162 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.956038 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.957382 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.958300 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.959190 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.037020 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:59.045754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ecdc16cc-e263-4f52-b7ad-c5e3234cf30d tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1277 microversion: 2.1 time: 0.111044 Aug 10 11:25:59.046439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 560/1103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:58 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:59.261486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:59.262818 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:59.270836 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.271334 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.271772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.272522 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.272978 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.273406 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.417528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:59.444595 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a83b8b35-0ef4-49cb-845e-d6dbd48ee0dd tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1315 microversion: 2.1 time: 0.186724 Aug 10 11:25:59.446096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 544/1104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:59 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:00.070040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:00.071086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:00.078728 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.079407 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.080285 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.081220 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.081840 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.082447 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.335629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7a42ae84-eb7f-4064-8b3b-e9a2fe94bb74 req-eb2e6ea5-e76e-41a9-a4f5-3d937ff0b341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9efee3-4389-41ad-af29-80e5aa1a01ee", "tag": "dd07d42c-9d2c-4733-a61c-b35f581947d3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:00.351104 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7a42ae84-eb7f-4064-8b3b-e9a2fe94bb74 req-eb2e6ea5-e76e-41a9-a4f5-3d937ff0b341 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.351586 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7a42ae84-eb7f-4064-8b3b-e9a2fe94bb74 req-eb2e6ea5-e76e-41a9-a4f5-3d937ff0b341 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.352025 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7a42ae84-eb7f-4064-8b3b-e9a2fe94bb74 req-eb2e6ea5-e76e-41a9-a4f5-3d937ff0b341 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.373151 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7a42ae84-eb7f-4064-8b3b-e9a2fe94bb74 req-eb2e6ea5-e76e-41a9-a4f5-3d937ff0b341 service nova] Creating event network-changed:dd07d42c-9d2c-4733-a61c-b35f581947d3 for instance 3d9efee3-4389-41ad-af29-80e5aa1a01ee on hv-cinder-85272 Aug 10 11:26:00.382267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7a42ae84-eb7f-4064-8b3b-e9a2fe94bb74 req-eb2e6ea5-e76e-41a9-a4f5-3d937ff0b341 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053333 Aug 10 11:26:00.385024 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 545/1105] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:00.472566 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:00.473811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:00.485479 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.486724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.487734 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.489179 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.490189 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.491173 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.580527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:00.589636 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2587b866-2c61-4797-abfb-00f29a9b38c9 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1319 microversion: 2.1 time: 0.523821 Aug 10 11:26:00.590902 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 561/1106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:00 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:00.648976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:00.657959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-040bf654-8055-4c09-8a6b-566cffd91566 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1464 microversion: 2.1 time: 0.192922 Aug 10 11:26:00.659043 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 546/1107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:00 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1464 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:00.711863 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:00.712110 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:00.718614 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.719118 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.719552 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.720254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.721063 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.721703 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.750877 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:26:00.836203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3d511581-3b1e-4e24-a1ea-c2ee86e1b603 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 204 len: 0 microversion: 2.1 time: 0.128900 Aug 10 11:26:00.837763 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 562/1108] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:26:00 2022] DELETE /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:26:00.847868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:00.849110 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:00.856160 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.857284 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.857791 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.858632 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.859245 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.859909 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.012974 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:01.020612 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c095f5a9-0765-48bb-b622-4452391cbc09 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1470 microversion: 2.1 time: 0.177737 Aug 10 11:26:01.021177 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 547/1109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:00 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:01.614666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:01.615377 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:01.622287 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.622810 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.623247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.623946 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.624397 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.624822 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.629135 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:01.778403 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:01.786032 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-16c1b8d9-298c-42a2-8651-a181f9b92eca tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1319 microversion: 2.1 time: 0.175657 Aug 10 11:26:01.786617 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 563/1110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:01 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:02.041829 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:02.042477 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:02.048744 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.049238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.049683 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.050390 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.050918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.051371 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.199155 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:02.207012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4e3888b2-6e81-40c5-ad34-07325dfda101 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1470 microversion: 2.1 time: 0.169244 Aug 10 11:26:02.207584 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 548/1111] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:02 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:02.807076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:02.807790 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:02.814333 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.814851 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.815292 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.815996 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.816448 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.816978 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.956420 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:02.964034 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7a0f6972-adb8-49a6-8d13-43b86c32eda2 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1319 microversion: 2.1 time: 0.160870 Aug 10 11:26:02.964541 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 564/1112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:02 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:03.228491 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:03.229339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:03.238923 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.239761 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.240551 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.241811 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.242621 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.243301 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.396656 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:03.404452 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85286240-bc0a-4d88-881a-c54f5f1d5f26 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1470 microversion: 2.1 time: 0.179907 Aug 10 11:26:03.405118 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 549/1113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:03 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:03.985180 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:03.985950 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:03.992672 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.993234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.993957 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.994702 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.995665 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.996093 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.132266 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:04.139800 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9c2c25d7-8022-4240-9df8-2f27f006323c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1319 microversion: 2.1 time: 0.158479 Aug 10 11:26:04.140388 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 565/1114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:03 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:04.425548 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:04.426116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:04.432582 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.433103 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.433510 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.434214 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.434695 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.435120 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.567748 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:04.575580 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c40af352-abe9-4434-97a8-ab34816a2830 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1470 microversion: 2.1 time: 0.154140 Aug 10 11:26:04.576148 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 550/1115] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:04 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:05.166214 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:05.168048 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:05.177609 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.178408 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.179207 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.180131 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.180708 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.181380 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.405755 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-88e83161-24e7-4315-8027-3e33b0b91a5f req-d0d647ee-2ed2-46d2-ac1e-c1257032f857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0abb581b-62c0-4d1d-a669-5002359e0f10", "name": "network-vif-deleted", "tag": "4f97f144-67c4-4e59-a9fe-64d13e2059ba"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:05.422489 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-88e83161-24e7-4315-8027-3e33b0b91a5f req-d0d647ee-2ed2-46d2-ac1e-c1257032f857 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.423431 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-88e83161-24e7-4315-8027-3e33b0b91a5f req-d0d647ee-2ed2-46d2-ac1e-c1257032f857 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.425175 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-88e83161-24e7-4315-8027-3e33b0b91a5f req-d0d647ee-2ed2-46d2-ac1e-c1257032f857 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.448210 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-88e83161-24e7-4315-8027-3e33b0b91a5f req-d0d647ee-2ed2-46d2-ac1e-c1257032f857 service nova] Creating event network-vif-deleted:4f97f144-67c4-4e59-a9fe-64d13e2059ba for instance 0abb581b-62c0-4d1d-a669-5002359e0f10 on hv-cinder-85272 Aug 10 11:26:05.455370 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-88e83161-24e7-4315-8027-3e33b0b91a5f req-d0d647ee-2ed2-46d2-ac1e-c1257032f857 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053870 Aug 10 11:26:05.456851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 551/1116] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:26:05.483044 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:05.504371 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d5fd4e41-40e1-48de-9c4b-225f5e7c6d89 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1319 microversion: 2.1 time: 0.347086 Aug 10 11:26:05.505692 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 566/1117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:05 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:05.598298 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:05.599064 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:05.601039 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:05.611324 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.611850 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.612299 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.613137 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.613634 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.614075 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.647521 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.647925 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.648372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.648829 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lazy-loading 'fault' on Instance uuid 0abb581b-62c0-4d1d-a669-5002359e0f10 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:26:05.707005 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de84a91a0f6e4a58813a48a3bc189f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56abb478c1f44508d3f22ab53b0af8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:05.714757 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c291b6d0-c17d-4997-abfd-8490cfa04b39 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 200 len: 1305 microversion: 2.1 time: 0.120842 Aug 10 11:26:05.715437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 552/1118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:05 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 1305 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:06.529583 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:06.530229 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:06.532143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:06.537439 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.537935 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.538367 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.539117 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.539566 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.539994 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.625613 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:06.647588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:06.684490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:06.692002 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5b66f87e-0e97-4101-9d60-ec799c92e54a tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1319 microversion: 2.1 time: 0.167057 Aug 10 11:26:06.692578 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 567/1119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:06 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:06.736199 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:06.736829 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] [instance: 0abb581b-62c0-4d1d-a669-5002359e0f10] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:06.743826 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.744317 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.744763 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.745934 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.746384 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.746829 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.760656 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] HTTP exception thrown: Instance 0abb581b-62c0-4d1d-a669-5002359e0f10 could not be found. Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Request method failure captured: Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 HTTP/1.1 Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85WukWUAm95soA4reUkrHWfiCSIDhTTYJO1j32iVzzUP_N5g8dlDT8bcS94g61wVqnH-iqxSLc9otxgcozIIL6rWhbtVlqK2H9MXZCQbcz2XJMiFlJBC2AFFhaSD904oWz4w650RoYAYJDT6-YBJ-HH05qlfg9Fe1F1_Uu0kTHhKdd4 Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: c56abb478c1f44508d3f22ab53b0af8c Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-442586254 Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:26:06.762937 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c56abb478c1f44508d3f22ab53b0af8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c56abb478c1f44508d3f22ab53b0af8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c56abb478c1f44508d3f22ab53b0af8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c56abb478c1f44508d3f22ab53b0af8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-442586254 Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: c56abb478c1f44508d3f22ab53b0af8c Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-442586254 Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-442586254-project Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: de84a91a0f6e4a58813a48a3bc189f9a Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-442586254-project Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 0abb581b-62c0-4d1d-a669-5002359e0f10 could not be found. Aug 10 11:26:06.764776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '0abb581b-62c0-4d1d-a669-5002359e0f10'} Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0abb581b-62c0-4d1d-a669-5002359e0f10 could not be found. Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:26:06.765736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0abb581b-62c0-4d1d-a669-5002359e0f10 could not be found. Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0abb581b-62c0-4d1d-a669-5002359e0f10 could not be found. Aug 10 11:26:06.767428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:06.768867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] Returning 404 to user: Instance 0abb581b-62c0-4d1d-a669-5002359e0f10 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:26:06.768867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c53dcc7f-68df-46ad-9515-2ffe8fc84928 tempest-VolumesNegativeTest-442586254 tempest-VolumesNegativeTest-442586254-project] 10.222.0.49 "GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10" status: 404 len: 111 microversion: 2.1 time: 0.032073 Aug 10 11:26:06.768867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 553/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:06 2022] GET /compute/v2.1/servers/0abb581b-62c0-4d1d-a669-5002359e0f10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:26:07.717154 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:07.718196 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:07.726729 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:07.727567 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:07.728898 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:07.730171 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:07.731884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:07.731884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:07.924754 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:07.933521 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b1d209a8-0702-4126-b36d-63e4b6178a04 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1319 microversion: 2.1 time: 0.222407 Aug 10 11:26:07.934234 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 568/1121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:07 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:08.958565 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:08.959227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:08.961192 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:08.969863 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.970382 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.970857 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.971587 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.972053 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.972487 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.186486 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:09.191651 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c21d64a0-c860-47bc-8b5a-c949ebf433b1 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1319 microversion: 2.1 time: 0.237176 Aug 10 11:26:09.192238 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 554/1122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:08 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:09.261662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-d516c630-bd27-4bc8-806b-6180d39e341a req-4d5c0f31-f192-4123-bc17-1bf073ab1dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9efee3-4389-41ad-af29-80e5aa1a01ee", "name": "network-vif-plugged", "status": "completed", "tag": "dd07d42c-9d2c-4733-a61c-b35f581947d3"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:09.272872 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d516c630-bd27-4bc8-806b-6180d39e341a req-4d5c0f31-f192-4123-bc17-1bf073ab1dbc service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.273335 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d516c630-bd27-4bc8-806b-6180d39e341a req-4d5c0f31-f192-4123-bc17-1bf073ab1dbc service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.273760 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-d516c630-bd27-4bc8-806b-6180d39e341a req-4d5c0f31-f192-4123-bc17-1bf073ab1dbc service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.292997 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-d516c630-bd27-4bc8-806b-6180d39e341a req-4d5c0f31-f192-4123-bc17-1bf073ab1dbc service nova] Creating event network-vif-plugged:dd07d42c-9d2c-4733-a61c-b35f581947d3 for instance 3d9efee3-4389-41ad-af29-80e5aa1a01ee on hv-cinder-85272 Aug 10 11:26:09.298888 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-d516c630-bd27-4bc8-806b-6180d39e341a req-4d5c0f31-f192-4123-bc17-1bf073ab1dbc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041351 Aug 10 11:26:09.299769 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 569/1123] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:10.221090 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:10.221840 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:10.229230 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:10.230218 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:10.230679 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:10.231613 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:10.232168 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:10.232646 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:10.398696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:10.407838 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a48bac7a-5ae2-40c8-9e0a-b991ac9341b6 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1319 microversion: 2.1 time: 0.190517 Aug 10 11:26:10.408427 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 555/1124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:10 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:11.430601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:11.432311 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:11.440364 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:11.441123 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:11.441850 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:11.442811 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:11.443622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:11.444216 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:11.605321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:11.619150 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5d4ae049-653f-42c2-ad95-bb7f368d2009 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1508 microversion: 2.1 time: 0.193298 Aug 10 11:26:11.619879 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 570/1125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:11 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:11.641631 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1a494bbb-4deb-427d-9ff1-2bedef6d1953 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f935267f-2d0b-40ca-bfbb-6e236f871674", "device": "/dev/sdb"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:11.645227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1a494bbb-4deb-427d-9ff1-2bedef6d1953 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:11.652660 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a494bbb-4deb-427d-9ff1-2bedef6d1953 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:11.653505 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a494bbb-4deb-427d-9ff1-2bedef6d1953 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:11.653957 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a494bbb-4deb-427d-9ff1-2bedef6d1953 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:11.654938 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a494bbb-4deb-427d-9ff1-2bedef6d1953 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:11.655658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a494bbb-4deb-427d-9ff1-2bedef6d1953 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:11.656235 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a494bbb-4deb-427d-9ff1-2bedef6d1953 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:11.995127 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1a494bbb-4deb-427d-9ff1-2bedef6d1953 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "POST /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357222 Aug 10 11:26:12.001239 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 556/1126] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:26:11 2022] POST /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:33.561727 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:33.562342 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:33.565202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=7 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:33.565846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=42 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:33.571606 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:33.572087 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:33.572527 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:33.573233 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:33.573714 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:33.574135 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:33.659050 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lazy-loading 'services' on Instance uuid 3d9efee3-4389-41ad-af29-80e5aa1a01ee {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:26:33.735964 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-24ae633f-f533-4c05-9eb6-8a727b194f32 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee/os-volume_attachments/f935267f-2d0b-40ca-bfbb-6e236f871674" status: 202 len: 0 microversion: 2.1 time: 0.177957 Aug 10 11:26:33.736589 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 571/1127] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:26:33 2022] DELETE /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee/os-volume_attachments/f935267f-2d0b-40ca-bfbb-6e236f871674 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:26:34.866304 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:34.867010 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:34.869625 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=11 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:34.870310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:34.878243 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:34.878778 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:34.879218 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:34.879994 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:34.880391 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:34.880816 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:34.924896 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:26:35.016463 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd89b254-3ed6-4327-90b7-f457420ab801 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 204 len: 0 microversion: 2.1 time: 0.154273 Aug 10 11:26:35.017251 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 557/1128] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:26:34 2022] DELETE /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:26:35.029029 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:35.030001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:35.037917 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:35.038406 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:35.038881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:35.039592 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:35.040041 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:35.040472 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:35.183712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:35.191558 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-729d8c3a-5a3d-4056-82ad-4e66f212f6df tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1514 microversion: 2.1 time: 0.169557 Aug 10 11:26:35.192136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 572/1129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:35 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:36.214022 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:36.214762 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:36.221505 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:36.221997 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:36.222437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:36.223167 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:36.223629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:36.224056 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:36.356952 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:36.364959 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-37d2390b-c204-4101-8bc2-0d2d972fca0b tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1514 microversion: 2.1 time: 0.155176 Aug 10 11:26:36.365539 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 558/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:36 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:37.385753 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:37.387082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:37.395052 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:37.395556 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:37.395999 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:37.396714 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:37.397176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:37.397630 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:37.622014 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:37.630059 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b13131a3-b1b9-498f-a115-5aabcb5d5962 tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1514 microversion: 2.1 time: 0.248508 Aug 10 11:26:37.630685 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 573/1131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:37 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:37.840106 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c2956f10-2dc5-4b61-ac04-0b786c7d56d2 req-c6d527d8-553a-4cdb-b98f-93f5a70cf552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9efee3-4389-41ad-af29-80e5aa1a01ee", "name": "network-vif-deleted", "tag": "dd07d42c-9d2c-4733-a61c-b35f581947d3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:37.850838 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c2956f10-2dc5-4b61-ac04-0b786c7d56d2 req-c6d527d8-553a-4cdb-b98f-93f5a70cf552 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:37.851242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c2956f10-2dc5-4b61-ac04-0b786c7d56d2 req-c6d527d8-553a-4cdb-b98f-93f5a70cf552 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:37.851691 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c2956f10-2dc5-4b61-ac04-0b786c7d56d2 req-c6d527d8-553a-4cdb-b98f-93f5a70cf552 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:37.868633 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c2956f10-2dc5-4b61-ac04-0b786c7d56d2 req-c6d527d8-553a-4cdb-b98f-93f5a70cf552 service nova] Creating event network-vif-deleted:dd07d42c-9d2c-4733-a61c-b35f581947d3 for instance 3d9efee3-4389-41ad-af29-80e5aa1a01ee on hv-cinder-85272 Aug 10 11:26:37.873454 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c2956f10-2dc5-4b61-ac04-0b786c7d56d2 req-c6d527d8-553a-4cdb-b98f-93f5a70cf552 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037650 Aug 10 11:26:37.874080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 559/1132] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:38.651588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:38.652542 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:38.658852 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:38.659346 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:38.659785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:38.660516 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:38.660976 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:38.661601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:38.696885 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:38.697384 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:38.697824 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:38.698284 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lazy-loading 'fault' on Instance uuid 3d9efee3-4389-41ad-af29-80e5aa1a01ee {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:26:38.757816 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de54cdce7634d7d9519722cfb67d45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50beb48049264dfe8b6a75937c1041fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:38.770853 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c890b521-7c66-41b0-9718-02f620f575cc tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 200 len: 1309 microversion: 2.1 time: 0.123586 Aug 10 11:26:38.771740 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 574/1133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:38 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:39.802721 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:39.803428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] [instance: 3d9efee3-4389-41ad-af29-80e5aa1a01ee] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:39.809709 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:39.810198 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:39.810661 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:39.811370 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:39.811827 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:39.812263 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:39.826815 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] HTTP exception thrown: Instance 3d9efee3-4389-41ad-af29-80e5aa1a01ee could not be found. Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Request method failure captured: Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee HTTP/1.1 Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85ViMPl9DQPM_A_Rd0Or_xhGyqYhsmkJrMAxeI2g8FUrW0SFFXIQuwNOBywbzjtwitoIgQn4ovPnvTAEdBywLvGlQ-VCuWSnk3AjCEdKmegnrt2IPggPtSV15XQP_-7Rc3DoCbRq5Ack3D2FGuWgeUMJyuJ45lwfMUjxK4CTc_n2e70 Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: 50beb48049264dfe8b6a75937c1041fe Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotTestJSON-937598806 Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:26:39.828476 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/50beb48049264dfe8b6a75937c1041fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50beb48049264dfe8b6a75937c1041fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50beb48049264dfe8b6a75937c1041fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_50beb48049264dfe8b6a75937c1041fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotTestJSON-937598806 Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 50beb48049264dfe8b6a75937c1041fe Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-937598806 Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotTestJSON-937598806-project Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 3de54cdce7634d7d9519722cfb67d45e Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotTestJSON-937598806-project Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 3d9efee3-4389-41ad-af29-80e5aa1a01ee could not be found. Aug 10 11:26:39.830080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '3d9efee3-4389-41ad-af29-80e5aa1a01ee'} Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9efee3-4389-41ad-af29-80e5aa1a01ee could not be found. Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:26:39.831008 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9efee3-4389-41ad-af29-80e5aa1a01ee could not be found. Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9efee3-4389-41ad-af29-80e5aa1a01ee could not be found. Aug 10 11:26:39.832976 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:26:39.834506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] Returning 404 to user: Instance 3d9efee3-4389-41ad-af29-80e5aa1a01ee could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:26:39.834506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ac3dbf74-562e-4d96-b463-b6650dbfa03c tempest-VolumesSnapshotTestJSON-937598806 tempest-VolumesSnapshotTestJSON-937598806-project] 10.222.0.49 "GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee" status: 404 len: 111 microversion: 2.1 time: 0.032167 Aug 10 11:26:39.834506 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 560/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:39 2022] GET /compute/v2.1/servers/3d9efee3-4389-41ad-af29-80e5aa1a01ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:26:42.867640 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:26:42.868136 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Wed Aug 10 11:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:27:22.130205 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:22.130864 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:22.133385 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=10 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:22.134061 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:22.144034 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b4d1edae-1078-4787-8a6d-6400beecd61a req-3cd08224-202e-4830-9c25-5713cf56cfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210aa1a7-389f-4708-9b3a-e0919befdaef", "tag": "0764a841-f90a-4927-a828-061ea8c8bf8c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:22.149134 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.149784 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.150240 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.151040 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.151515 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.151935 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.158987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:22.160351 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:22.171370 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4d1edae-1078-4787-8a6d-6400beecd61a req-3cd08224-202e-4830-9c25-5713cf56cfa0 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.171788 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4d1edae-1078-4787-8a6d-6400beecd61a req-3cd08224-202e-4830-9c25-5713cf56cfa0 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.172594 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4d1edae-1078-4787-8a6d-6400beecd61a req-3cd08224-202e-4830-9c25-5713cf56cfa0 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.191692 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b4d1edae-1078-4787-8a6d-6400beecd61a req-3cd08224-202e-4830-9c25-5713cf56cfa0 service nova] Creating event network-changed:0764a841-f90a-4927-a828-061ea8c8bf8c for instance 210aa1a7-389f-4708-9b3a-e0919befdaef on hv-cinder-85272 Aug 10 11:27:22.201710 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b4d1edae-1078-4787-8a6d-6400beecd61a req-3cd08224-202e-4830-9c25-5713cf56cfa0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067336 Aug 10 11:27:22.207752 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 561/1135] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:27:22.210651 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:27:22.325830 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fd280e27-773a-4a49-86f0-f016ad21a569 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "DELETE /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 204 len: 0 microversion: 2.1 time: 0.196726 Aug 10 11:27:22.328186 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 575/1136] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:27:22 2022] DELETE /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:27:22.337287 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:22.337994 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:22.350194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.350564 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.351215 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.352123 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.352740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.353325 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.631657 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:22.647700 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2b3eb243-1429-4055-bf0f-417704a85393 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.315284 Aug 10 11:27:22.648739 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 562/1137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:22 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:27:23.676226 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:23.677609 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:23.684938 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:23.685724 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:23.687203 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:23.688225 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:23.688988 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:23.689580 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:23.934971 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:23.945202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9b1d7fc3-dc7c-4977-bc26-9424fd72a33f tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1569 microversion: 2.1 time: 0.274902 Aug 10 11:27:23.961601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 576/1138] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:23 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1569 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:24.970116 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:24.971403 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:24.985927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:24.986673 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:24.988644 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:24.990698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:24.992047 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:24.993533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:25.379228 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:25.389521 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-51e97e64-37c4-45e3-9abe-17f8986813a1 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1451 microversion: 2.1 time: 0.425720 Aug 10 11:27:25.390115 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 563/1139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:24 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1451 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:25.529101 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-a4b4fc1a-e2de-490f-9470-f399b64a88e2 req-e09a4f60-4b86-491e-bec4-75ebe13ff8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210aa1a7-389f-4708-9b3a-e0919befdaef", "name": "network-vif-deleted", "tag": "0764a841-f90a-4927-a828-061ea8c8bf8c"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:25.562189 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-a4b4fc1a-e2de-490f-9470-f399b64a88e2 req-e09a4f60-4b86-491e-bec4-75ebe13ff8ec service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:25.562625 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-a4b4fc1a-e2de-490f-9470-f399b64a88e2 req-e09a4f60-4b86-491e-bec4-75ebe13ff8ec service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:25.563070 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-a4b4fc1a-e2de-490f-9470-f399b64a88e2 req-e09a4f60-4b86-491e-bec4-75ebe13ff8ec service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:25.577358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-a4b4fc1a-e2de-490f-9470-f399b64a88e2 req-e09a4f60-4b86-491e-bec4-75ebe13ff8ec service nova] Creating event network-vif-deleted:0764a841-f90a-4927-a828-061ea8c8bf8c for instance 210aa1a7-389f-4708-9b3a-e0919befdaef on hv-cinder-85272 Aug 10 11:27:25.583420 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-a4b4fc1a-e2de-490f-9470-f399b64a88e2 req-e09a4f60-4b86-491e-bec4-75ebe13ff8ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059493 Aug 10 11:27:25.584973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 577/1140] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:26.414350 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:26.415762 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:26.425672 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:26.426423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:26.426960 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:26.427917 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:26.428415 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:26.428855 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:26.490910 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:26.491698 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:26.492341 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:26.492972 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lazy-loading 'fault' on Instance uuid 210aa1a7-389f-4708-9b3a-e0919befdaef {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:27:26.550094 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1734d2f354a247d680f3c6fe7071632c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa6be82e0004c208037e16b0bfc23a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:26.561037 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f39faba-d011-4fca-b3ff-3f0b73620d8e tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 200 len: 1225 microversion: 2.1 time: 0.151598 Aug 10 11:27:26.561644 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 564/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:26 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 1225 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:27.583013 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:27.584084 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [instance: 210aa1a7-389f-4708-9b3a-e0919befdaef] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:27.591361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:27.593666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:27.594245 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:27.595251 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:27.595983 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:27.596664 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:27.613329 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] HTTP exception thrown: Instance 210aa1a7-389f-4708-9b3a-e0919befdaef could not be found. Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Request method failure captured: Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef HTTP/1.1 Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept: application/json Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Connection: close Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Length: 0 Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Content-Type: application/json Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Host: 10.222.0.49 Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.11 Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi85SWQjerLkrlJNwBNMvHwEEAGCc_3uEyZCQxrxS_xSt3UxERSIXpE5jN-WBD_O1IqR6OLuETaBKQXRrnrU2UAJM7FsshQhoK_lFCRuuygHD35A1oIy3WA-Tv0yIUu6QU6DVE8s-PZCpIWRsVCNgylydjCqI6fz02jiMTXE3kmARdiHk Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Id: 5fa6be82e0004c208037e16b0bfc23a2 Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestShelveInstance-1339504630 Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Role: member,reader Aug 10 11:27:27.615299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Roles: member,reader Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5fa6be82e0004c208037e16b0bfc23a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5fa6be82e0004c208037e16b0bfc23a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5fa6be82e0004c208037e16b0bfc23a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5fa6be82e0004c208037e16b0bfc23a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestShelveInstance-1339504630 Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 5fa6be82e0004c208037e16b0bfc23a2 Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestShelveInstance-1339504630 Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User: tempest-TestShelveInstance-1339504630-project Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Id: 1734d2f354a247d680f3c6fe7071632c Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestShelveInstance-1339504630-project Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: method: > Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: exception: Instance 210aa1a7-389f-4708-9b3a-e0919befdaef could not be found. Aug 10 11:27:27.617001 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: action_args: {'id': '210aa1a7-389f-4708-9b3a-e0919befdaef'} Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210aa1a7-389f-4708-9b3a-e0919befdaef could not be found. Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:27:27.617886 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210aa1a7-389f-4708-9b3a-e0919befdaef could not be found. Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210aa1a7-389f-4708-9b3a-e0919befdaef could not be found. Aug 10 11:27:27.619389 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Aug 10 11:27:27.620764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Returning 404 to user: Instance 210aa1a7-389f-4708-9b3a-e0919befdaef could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:27:27.620764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-98a46192-8261-40ef-b583-c8f0fda045b5 tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef" status: 404 len: 111 microversion: 2.1 time: 0.039153 Aug 10 11:27:27.620764 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 578/1142] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:27 2022] GET /compute/v2.1/servers/210aa1a7-389f-4708-9b3a-e0919befdaef => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:27:27.825847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-54f4b16a-e2b9-4d4d-b3a9-43902b68ab7d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] Calling method '.version_select at 0x7fccf80e93a0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:27.829944 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54f4b16a-e2b9-4d4d-b3a9-43902b68ab7d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [5b329f0b-d090-41a5-9050-890260c90222] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 11:27:28.842327 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [None req-54f4b16a-e2b9-4d4d-b3a9-43902b68ab7d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] [5b329f0b-d090-41a5-9050-890260c90222] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 56032. Aug 10 11:27:28.874128 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-54f4b16a-e2b9-4d4d-b3a9-43902b68ab7d tempest-TestShelveInstance-1339504630 tempest-TestShelveInstance-1339504630-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2130847063" status: 202 len: 0 microversion: 2.1 time: 1.053570 Aug 10 11:27:28.875004 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 565/1143] 10.222.0.49 () {58 vars in 1254 bytes} [Wed Aug 10 11:27:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2130847063 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:27:38.584487 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-34a75e82-161e-4d32-95a5-bdc71b39cbb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Action: 'create', calling method: .version_select at 0x7fccf8360af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-694377268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvlC/wePPQ6tW+Lz5xKCyTsOjPYW6r/fR8GHKq2OsvIJv7mqDi7SInmcQNVhX+8FY8ztE7+vXoobQKaxMPBlGR+3EcRSFibGDQXHajKmDPnpxmpXxaZHLZmrvLl918Bsw=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:38.590204 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:38.590892 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:38.606455 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-34a75e82-161e-4d32-95a5-bdc71b39cbb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Getting quotas for project f177eb8b84f3461a8957a8171381638a. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:27:38.611666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-34a75e82-161e-4d32-95a5-bdc71b39cbb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Getting quotas for user 432f5f0682b143f8a4e1319f2285da5e and project f177eb8b84f3461a8957a8171381638a. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:27:38.638065 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-34a75e82-161e-4d32-95a5-bdc71b39cbb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057839 Aug 10 11:27:38.638712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 579/1144] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 11:27:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:38.743884 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=22 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:38.749283 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-440553529", "imageRef": "1444d46b-2ccf-454f-a09b-eb5e0270dd4e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-694377268", "networks": [{"uuid": "6ddefaaa-23a4-42fe-8d2b-6c877e51f69b"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:38.806156 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] validate_networks() for [('6ddefaaa-23a4-42fe-8d2b-6c877e51f69b', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:27:39.493467 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:27:39.493895 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:27:39.494378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:27:39.494832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:27:39.495248 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:27:39.505354 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:39.505859 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:39.506282 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:39.507070 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:39.507507 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:39.507973 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:39.526375 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Getting quotas for project f177eb8b84f3461a8957a8171381638a. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:27:39.530719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Getting quotas for user 432f5f0682b143f8a4e1319f2285da5e and project f177eb8b84f3461a8957a8171381638a. Resources: {'ram', 'cores', 'instances'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:27:39.542847 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:27:39.545030 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1444d46b-2ccf-454f-a09b-eb5e0270dd4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:27:39.593071 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4a7be870-3825-41aa-942b-cfa02b6853b3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850676 Aug 10 11:27:39.593704 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 566/1145] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 11:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:27:39.605176 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-99e91b6b-2bb3-4fd6-9cc7-ddf2594afd4a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:39.606252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-99e91b6b-2bb3-4fd6-9cc7-ddf2594afd4a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:39.663690 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-99e91b6b-2bb3-4fd6-9cc7-ddf2594afd4a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:39.672201 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-99e91b6b-2bb3-4fd6-9cc7-ddf2594afd4a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1257 microversion: 2.1 time: 0.071583 Aug 10 11:27:39.672791 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 580/1146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:39 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:40.694078 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:40.695051 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:40.701623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:40.702267 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:40.702831 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:40.703627 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:40.704153 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:40.704799 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:40.771779 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:40.781740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c34e79ea-8cda-4425-8dca-b30190167791 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1327 microversion: 2.1 time: 0.091971 Aug 10 11:27:40.782716 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 567/1147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:40 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:27:41.807256 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:41.809350 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:41.816540 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:41.817055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:41.817492 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:41.818363 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:41.818861 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:41.819316 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:41.976875 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:41.985274 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4a4ef0c5-7549-4fec-a1a5-7884da9c6cb1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.183535 Aug 10 11:27:41.985984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 581/1148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:41 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:43.006883 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:43.007493 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:43.014209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:43.014737 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:43.015174 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:43.015897 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:43.016405 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:43.016832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:43.174364 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:43.182316 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2247b2ed-2d76-442f-82c9-3af5a7f03f6f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.179149 Aug 10 11:27:43.182918 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 568/1149] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:43 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:44.205056 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:44.205663 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:44.212713 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:44.213201 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:44.213636 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:44.214332 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:44.215643 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:44.216072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:44.356463 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:44.364525 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1bf6a54c-2ebe-4d7a-87f6-8342b3994b6b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.163245 Aug 10 11:27:44.365383 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 582/1150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:44 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:45.388528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:45.389187 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:45.398207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:45.399021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:45.399866 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:45.401110 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:45.402969 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:45.403639 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:45.557021 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:45.565129 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1e8303d1-0872-4a5b-9020-6826d84bbeb9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.180497 Aug 10 11:27:45.575690 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 569/1151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:45 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:46.586155 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:46.587963 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:46.595751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:46.595751 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:46.596038 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:46.596594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:46.597055 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:46.597680 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:46.767538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:46.775682 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8db1a17a-a9a6-472f-bb4c-e9855a983a5e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.193845 Aug 10 11:27:46.776479 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 583/1152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:46 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:47.801866 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:47.802670 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:47.810287 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:47.811158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:47.811930 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:47.812966 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:47.813428 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:47.813854 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:47.965628 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:47.973876 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-11baf376-1c2c-4465-84b0-258a7f761981 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.180846 Aug 10 11:27:47.974691 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 570/1153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:47 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:48.995086 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:48.995739 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:49.003539 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:49.004042 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:49.004485 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:49.005202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:49.005660 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:49.006082 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:49.143737 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:49.151363 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-80e76132-0509-47ca-8e0a-a8f4deabf051 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.160189 Aug 10 11:27:49.151935 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 584/1154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:48 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:50.174469 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:50.175119 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:50.177420 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:50.178087 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:50.184360 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:50.184856 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:50.185290 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:50.185987 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:50.186439 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:50.186900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:50.324048 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:50.331504 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82c937a8-fe5e-42eb-bd55-3938fea3db20 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.160860 Aug 10 11:27:50.332292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 571/1155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:50 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:51.352737 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:51.353329 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:51.356811 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:51.361919 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:51.362445 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:51.362909 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:51.363623 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:51.364077 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:51.364506 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:51.500064 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:51.507711 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-60b083f7-1fa7-484f-b219-91c960fd5859 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.158870 Aug 10 11:27:51.508494 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 585/1156] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:51 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:52.529553 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:52.530173 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:52.532945 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:52.540082 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:52.540587 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:52.541029 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:52.541912 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:52.542410 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:52.542904 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:52.687599 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:52.695696 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-937437f6-dfe3-4f02-b7e2-7f1c978dbfbd tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.170590 Aug 10 11:27:52.696292 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 572/1157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:52 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:52.974709 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-1545857a-9bbd-49a2-a96e-7c69f0ae653f req-027d8649-1258-4512-80d9-fa97295c0d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203bc62a-cc5e-4cb5-9613-72eeac844d8c", "tag": "f5ef0611-98f6-4baf-81f8-25512797d5fe"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:52.984330 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1545857a-9bbd-49a2-a96e-7c69f0ae653f req-027d8649-1258-4512-80d9-fa97295c0d62 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:52.984814 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1545857a-9bbd-49a2-a96e-7c69f0ae653f req-027d8649-1258-4512-80d9-fa97295c0d62 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:52.985232 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1545857a-9bbd-49a2-a96e-7c69f0ae653f req-027d8649-1258-4512-80d9-fa97295c0d62 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:53.004676 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-1545857a-9bbd-49a2-a96e-7c69f0ae653f req-027d8649-1258-4512-80d9-fa97295c0d62 service nova] Creating event network-changed:f5ef0611-98f6-4baf-81f8-25512797d5fe for instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c on hv-cinder-85272 Aug 10 11:27:53.010143 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-1545857a-9bbd-49a2-a96e-7c69f0ae653f req-027d8649-1258-4512-80d9-fa97295c0d62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039019 Aug 10 11:27:53.011254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 586/1158] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:53.718280 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:53.719242 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:53.725446 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:53.725935 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:53.726372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:53.727111 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:53.727629 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:53.728061 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:53.861535 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:53.869497 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-94875faf-a937-4d64-b76a-92dd434351e1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.155234 Aug 10 11:27:53.870080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 573/1159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:53 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:27:54.891027 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:54.891767 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:54.898111 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:54.898608 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:54.899048 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:54.899749 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:54.900199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:54.900622 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:55.040158 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:55.048300 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3ab29807-31ac-4aeb-a4ae-f9ee7f331f44 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.162019 Aug 10 11:27:55.048889 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 587/1160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:54 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:56.069517 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:56.070083 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:56.076707 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:56.077204 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:56.077646 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:56.078363 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:56.078857 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:56.079287 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:56.388555 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:56.396158 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-896534a7-0e88-422f-9ec2-354bd4dcb710 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.330633 Aug 10 11:27:56.396735 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 574/1161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:56 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:57.417848 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:57.419071 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:57.425498 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:57.425983 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:57.426417 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:57.427156 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:57.427609 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:57.428030 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:57.613940 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:57.621621 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3ac2caf8-eb8f-4c8a-9791-e2171935db46 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.207727 Aug 10 11:27:57.622212 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 588/1162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:57 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:58.643112 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:58.643736 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:58.650194 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:58.650719 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:58.651163 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:58.651870 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:58.652346 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:58.652756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:58.784560 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:58.792214 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa63198d-6940-4f5f-aa0c-df7e29faffa8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.153137 Aug 10 11:27:58.792797 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 575/1163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:58 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:59.225985 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:27:59.226596 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Wed Aug 10 11:27:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:27:59.758566 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-b5d63180-36d5-4598-bbf8-f5397bcd9a9f req-c47e7dd7-a497-48de-9431-383f43cd7e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203bc62a-cc5e-4cb5-9613-72eeac844d8c", "name": "network-vif-plugged", "status": "completed", "tag": "f5ef0611-98f6-4baf-81f8-25512797d5fe"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:59.769015 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b5d63180-36d5-4598-bbf8-f5397bcd9a9f req-c47e7dd7-a497-48de-9431-383f43cd7e3e service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:59.769497 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b5d63180-36d5-4598-bbf8-f5397bcd9a9f req-c47e7dd7-a497-48de-9431-383f43cd7e3e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:59.769931 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b5d63180-36d5-4598-bbf8-f5397bcd9a9f req-c47e7dd7-a497-48de-9431-383f43cd7e3e service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:59.782308 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-b5d63180-36d5-4598-bbf8-f5397bcd9a9f req-c47e7dd7-a497-48de-9431-383f43cd7e3e service nova] Creating event network-vif-plugged:f5ef0611-98f6-4baf-81f8-25512797d5fe for instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c on hv-cinder-85272 Aug 10 11:27:59.787404 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-b5d63180-36d5-4598-bbf8-f5397bcd9a9f req-c47e7dd7-a497-48de-9431-383f43cd7e3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032583 Aug 10 11:27:59.788209 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 589/1164] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:27:59.813756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:59.814404 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:59.821875 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:59.822738 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:59.823186 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:59.823901 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:59.824359 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:59.824851 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:59.976244 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:59.984209 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5ae3cea9-c711-4731-9829-892034d3e8ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.174558 Aug 10 11:27:59.984788 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 576/1165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:59 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:01.007783 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:01.008512 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:01.014984 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:01.015476 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:01.016098 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:01.016806 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:01.017512 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:01.017950 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:01.151783 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:01.160486 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8143ca3e-d886-47a7-93e6-c5e0379dd9da tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1357 microversion: 2.1 time: 0.157564 Aug 10 11:28:01.161057 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 590/1166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:01 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:02.182743 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:02.183346 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:02.190262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.190785 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.191223 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.192688 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.192688 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.192936 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.329227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:02.337029 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0de15180-814c-45ae-97d0-10ca1895c0bf tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1547 microversion: 2.1 time: 0.158197 Aug 10 11:28:02.337610 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 577/1167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:02 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:02.357846 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:02.358490 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:02.365250 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.365736 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.366173 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.366921 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.367381 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.367807 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.501111 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:02.508859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b8df8425-6bd4-4836-b3f0-7bb1c006adae tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1547 microversion: 2.1 time: 0.155518 Aug 10 11:28:02.509435 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 591/1168] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:02 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:02.529867 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:02.534604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:02.535362 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Searching by: {'deleted': False, 'project_id': 'f177eb8b84f3461a8957a8171381638a'} {{(pid=117920) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 11:28:02.541832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.542308 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.542786 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.543604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.544062 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.544494 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.638346 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.multi_cell_list [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 11:28:02.731122 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-94c353d3-4490-4b5e-b029-515a1664323f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205391 Aug 10 11:28:02.731623 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 578/1169] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 10 11:28:02 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:28:02.743046 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:02.743657 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:02.750432 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.750958 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.751394 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.752111 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.752564 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.752991 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.886842 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:02.894939 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5d3bda28-4fd8-4e93-a2ac-b5a805d274fe tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1547 microversion: 2.1 time: 0.155685 Aug 10 11:28:02.895515 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 592/1170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:02 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:04.455633 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa89a8cd-382b-4d2e-bef0-04a81a20ee9d tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aea26fd4-31b2-4861-aa8b-3ffab9600aa8"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:04.457931 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa89a8cd-382b-4d2e-bef0-04a81a20ee9d tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:04.464668 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa89a8cd-382b-4d2e-bef0-04a81a20ee9d tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:04.465783 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa89a8cd-382b-4d2e-bef0-04a81a20ee9d tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:04.466231 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa89a8cd-382b-4d2e-bef0-04a81a20ee9d tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:04.467012 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa89a8cd-382b-4d2e-bef0-04a81a20ee9d tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:04.467456 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa89a8cd-382b-4d2e-bef0-04a81a20ee9d tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:04.467907 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa89a8cd-382b-4d2e-bef0-04a81a20ee9d tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:04.735437 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa89a8cd-382b-4d2e-bef0-04a81a20ee9d tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "POST /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283373 Aug 10 11:28:04.736056 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 579/1171] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 11:28:04 2022] POST /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:28:12.382137 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:12.382972 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:12.385099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:12.392136 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:12.392631 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:12.393072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:12.393780 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:12.394235 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:12.394712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:12.398283 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=65 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:12.530120 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:12.538073 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-179ebebd-0392-404f-a536-b17874f4134e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1593 microversion: 2.1 time: 0.160004 Aug 10 11:28:12.538671 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 593/1172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:12 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1593 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:14.257180 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-dd8299da-0fde-4045-9ca2-1da72b44f28d req-c5628874-0953-483d-854c-1282ff040422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203bc62a-cc5e-4cb5-9613-72eeac844d8c", "tag": "f5ef0611-98f6-4baf-81f8-25512797d5fe"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:14.263348 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:14.270400 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dd8299da-0fde-4045-9ca2-1da72b44f28d req-c5628874-0953-483d-854c-1282ff040422 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:14.270942 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dd8299da-0fde-4045-9ca2-1da72b44f28d req-c5628874-0953-483d-854c-1282ff040422 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:14.271385 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dd8299da-0fde-4045-9ca2-1da72b44f28d req-c5628874-0953-483d-854c-1282ff040422 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:14.275779 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:14.285528 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-dd8299da-0fde-4045-9ca2-1da72b44f28d req-c5628874-0953-483d-854c-1282ff040422 service nova] Creating event network-changed:f5ef0611-98f6-4baf-81f8-25512797d5fe for instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c on hv-cinder-85272 Aug 10 11:28:14.291740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-dd8299da-0fde-4045-9ca2-1da72b44f28d req-c5628874-0953-483d-854c-1282ff040422 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038436 Aug 10 11:28:14.292360 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 580/1173] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:28:15.428301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-232458119"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:15.429354 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:15.436338 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:15.436829 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:15.438215 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:15.438215 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:15.439112 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:15.439307 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:15.595698 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.network.security_group_api [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Adding security group d888f833-7e67-455c-b594-4c837fda5799 to port f5ef0611-98f6-4baf-81f8-25512797d5fe Aug 10 11:28:15.944247 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-db0b498a-3ea0-4d89-ab4b-e871713ad21f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "POST /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.521450 Aug 10 11:28:15.945293 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 594/1174] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:28:15 2022] POST /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:28:15.955415 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:15.956202 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:15.963723 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:15.964220 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:15.964661 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:15.965376 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:15.966686 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:15.967555 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:16.166212 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:16.174787 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c2151962-c599-4ba0-843f-04a6d7a5bd55 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1757 microversion: 2.1 time: 0.224952 Aug 10 11:28:16.175374 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 581/1175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:15 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:16.306164 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-44f48249-5ec4-45c8-bd6e-709b3accbbad req-ed00904e-f5ac-4d68-9fac-81de0a82dbfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203bc62a-cc5e-4cb5-9613-72eeac844d8c", "tag": "f5ef0611-98f6-4baf-81f8-25512797d5fe"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:16.316495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-44f48249-5ec4-45c8-bd6e-709b3accbbad req-ed00904e-f5ac-4d68-9fac-81de0a82dbfe service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:16.317062 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-44f48249-5ec4-45c8-bd6e-709b3accbbad req-ed00904e-f5ac-4d68-9fac-81de0a82dbfe service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:16.317565 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-44f48249-5ec4-45c8-bd6e-709b3accbbad req-ed00904e-f5ac-4d68-9fac-81de0a82dbfe service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:16.329859 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-44f48249-5ec4-45c8-bd6e-709b3accbbad req-ed00904e-f5ac-4d68-9fac-81de0a82dbfe service nova] Creating event network-changed:f5ef0611-98f6-4baf-81f8-25512797d5fe for instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c on hv-cinder-85272 Aug 10 11:28:16.335028 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-44f48249-5ec4-45c8-bd6e-709b3accbbad req-ed00904e-f5ac-4d68-9fac-81de0a82dbfe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032529 Aug 10 11:28:16.336825 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 595/1176] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:29:16.998426 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=19 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:16.999222 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:17.003251 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4d506a11-fcaf-4bfc-8abf-a2a6ead2a03a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:17.005524 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4d506a11-fcaf-4bfc-8abf-a2a6ead2a03a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:17.012253 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d506a11-fcaf-4bfc-8abf-a2a6ead2a03a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.012730 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d506a11-fcaf-4bfc-8abf-a2a6ead2a03a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.013772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d506a11-fcaf-4bfc-8abf-a2a6ead2a03a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.014473 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d506a11-fcaf-4bfc-8abf-a2a6ead2a03a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.014953 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d506a11-fcaf-4bfc-8abf-a2a6ead2a03a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.015372 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d506a11-fcaf-4bfc-8abf-a2a6ead2a03a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.089849 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4d506a11-fcaf-4bfc-8abf-a2a6ead2a03a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "POST /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.093268 Aug 10 11:29:17.090544 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 582/1177] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:29:16 2022] POST /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:29:17.098157 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=5 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:17.099208 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=11 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:17.105400 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:17.106244 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:17.114664 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.115156 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.115591 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.116291 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.116748 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.117174 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.270601 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:17.279514 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f6a5056a-b034-4324-a3c4-95d5baae5e50 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1749 microversion: 2.1 time: 0.183168 Aug 10 11:29:17.280302 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 596/1178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:17 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1749 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:18.314029 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:18.314763 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:18.321088 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:18.321574 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:18.322010 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:18.322742 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:18.323196 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:18.323619 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:18.476019 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:18.484692 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a4df5943-3a56-4349-995b-439b535c29be tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.176282 Aug 10 11:29:18.485438 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 583/1179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:18 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:19.506359 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:19.507090 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:19.518661 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.519531 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.520339 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.521537 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.522466 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.522466 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.666352 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:19.674380 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f47665c2-6a8b-4022-a670-934c18000e69 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.171911 Aug 10 11:29:19.674973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 597/1180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:19 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:20.695413 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:20.696022 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:20.702434 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:20.702943 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:20.703378 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:20.704276 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:20.704728 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:20.705154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:20.860834 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:20.869758 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82205a58-04b6-4e69-a6aa-8afb02d4976c tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.178149 Aug 10 11:29:20.870339 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 584/1181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:20 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:21.890254 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:21.890883 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:21.897640 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.898255 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.898730 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:21.899296 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.899755 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.900219 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:22.051432 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:22.059470 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d0b555e6-55d0-4b74-840b-d4386cd91ad3 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.173284 Aug 10 11:29:22.060588 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 598/1182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:21 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:23.081815 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:23.082436 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:23.089193 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:23.089682 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:23.090121 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:23.090852 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:23.091312 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:23.091740 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:23.237340 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:23.245312 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-63291ff9-7cdf-47c3-822c-cc696bc9c366 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.167371 Aug 10 11:29:23.245879 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 585/1183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:23 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:24.267468 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:24.268103 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:24.274885 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:24.275374 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:24.275815 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:24.276538 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:24.276996 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:24.277426 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:24.440251 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:24.448547 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fe3705a6-223d-4843-883b-29022e97f6f0 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.184990 Aug 10 11:29:24.449132 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 599/1184] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:24 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:25.470083 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:25.470731 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:25.477662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:25.478007 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:25.478446 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:25.479200 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:25.479654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:25.480080 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:25.634939 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:25.643772 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-53d6b94d-df76-4c8e-a338-6d530bcee7fb tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.178161 Aug 10 11:29:25.644591 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 586/1185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:25 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:26.665358 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:26.665962 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:26.673021 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:26.673507 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:26.673940 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:26.674656 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:26.675109 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:26.675528 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:26.822566 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:26.830625 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4a75df36-8da3-4f0e-b9d7-1179d9092d80 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.169129 Aug 10 11:29:26.831195 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 600/1186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:26 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:27.852573 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:27.853182 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:27.860207 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:27.860695 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:27.861131 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:27.861832 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:27.862281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:27.862732 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:28.023756 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:28.035730 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e79e11d0-a27c-4c24-8fe4-6129fcf41d03 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.187002 Aug 10 11:29:28.036310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 587/1187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:27 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:29.057199 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:29.057807 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:29.064495 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:29.064973 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:29.065406 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:29.066092 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:29.066540 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:29.066987 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:29.215108 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:29.223576 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2844b156-11a6-4306-9d0b-f14904766dea tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1754 microversion: 2.1 time: 0.170249 Aug 10 11:29:29.224142 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 601/1188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:29 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:30.245096 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:30.245694 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:30.252417 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:30.252899 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:30.253333 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:30.254033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:30.254485 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:30.254936 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:30.404459 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:30.412507 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-14e42781-2ef0-4622-ac90-a6f1226c92ee tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1757 microversion: 2.1 time: 0.171246 Aug 10 11:29:30.413076 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 588/1189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:30 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:02.877044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:30:02.877748 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Wed Aug 10 11:30:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:30:19.054712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:30:19.055317 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Wed Aug 10 11:30:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:30:25.224334 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-232458119"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:25.225072 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:25.227594 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=12 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:25.228076 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=36 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:25.234202 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:25.234719 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:25.235153 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:25.235852 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:25.236301 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:25.236721 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:25.382695 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.network.security_group_api [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Removing security group d888f833-7e67-455c-b594-4c837fda5799 from port f5ef0611-98f6-4baf-81f8-25512797d5fe Aug 10 11:30:25.704138 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d8a73d56-e5e8-4aa0-ad56-c1d1b25f4f6e tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "POST /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.484047 Aug 10 11:30:25.704967 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 602/1190] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 11:30:25 2022] POST /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:30:25.724179 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=14 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:25.724812 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:25.840868 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-14e37d98-c36c-4d79-8e71-85b2fcaae928 req-a71ea20e-ee48-457d-8c3b-a36ea8280627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203bc62a-cc5e-4cb5-9613-72eeac844d8c", "tag": "f5ef0611-98f6-4baf-81f8-25512797d5fe"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:25.857432 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-14e37d98-c36c-4d79-8e71-85b2fcaae928 req-a71ea20e-ee48-457d-8c3b-a36ea8280627 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:25.859472 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-14e37d98-c36c-4d79-8e71-85b2fcaae928 req-a71ea20e-ee48-457d-8c3b-a36ea8280627 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:25.860560 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-14e37d98-c36c-4d79-8e71-85b2fcaae928 req-a71ea20e-ee48-457d-8c3b-a36ea8280627 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:25.877418 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-14e37d98-c36c-4d79-8e71-85b2fcaae928 req-a71ea20e-ee48-457d-8c3b-a36ea8280627 service nova] Creating event network-changed:f5ef0611-98f6-4baf-81f8-25512797d5fe for instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c on hv-cinder-85272 Aug 10 11:30:25.887675 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-14e37d98-c36c-4d79-8e71-85b2fcaae928 req-a71ea20e-ee48-457d-8c3b-a36ea8280627 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178113 Aug 10 11:30:25.890423 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 589/1191] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:27.685942 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:27.686541 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:27.693770 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.694264 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.694729 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.695436 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.695884 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.696299 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.753362 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-2c8926cd-29b4-47d5-8bb8-6e86e442a3da req-5bdccc4f-7968-480e-ad07-46658cbce654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203bc62a-cc5e-4cb5-9613-72eeac844d8c", "tag": "f5ef0611-98f6-4baf-81f8-25512797d5fe"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:27.765845 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2c8926cd-29b4-47d5-8bb8-6e86e442a3da req-5bdccc4f-7968-480e-ad07-46658cbce654 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.766444 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2c8926cd-29b4-47d5-8bb8-6e86e442a3da req-5bdccc4f-7968-480e-ad07-46658cbce654 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.766977 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2c8926cd-29b4-47d5-8bb8-6e86e442a3da req-5bdccc4f-7968-480e-ad07-46658cbce654 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.780458 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-2c8926cd-29b4-47d5-8bb8-6e86e442a3da req-5bdccc4f-7968-480e-ad07-46658cbce654 service nova] Creating event network-changed:f5ef0611-98f6-4baf-81f8-25512797d5fe for instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c on hv-cinder-85272 Aug 10 11:30:27.786310 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-2c8926cd-29b4-47d5-8bb8-6e86e442a3da req-5bdccc4f-7968-480e-ad07-46658cbce654 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109681 Aug 10 11:30:27.788349 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 590/1192] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:27.790823 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lazy-loading 'services' on Instance uuid 203bc62a-cc5e-4cb5-9613-72eeac844d8c {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:27.880191 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7855b83e-f6b2-4415-ac73-6599389600dc tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "DELETE /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments/aea26fd4-31b2-4861-aa8b-3ffab9600aa8" status: 202 len: 0 microversion: 2.1 time: 0.205715 Aug 10 11:30:27.881222 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 603/1193] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:30:27 2022] DELETE /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments/aea26fd4-31b2-4861-aa8b-3ffab9600aa8 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:30:27.897835 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-43d800df-d5a6-4b92-99f5-3bcf41181804 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:27.903044 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43d800df-d5a6-4b92-99f5-3bcf41181804 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:27.913927 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43d800df-d5a6-4b92-99f5-3bcf41181804 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.915212 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43d800df-d5a6-4b92-99f5-3bcf41181804 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.915662 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43d800df-d5a6-4b92-99f5-3bcf41181804 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.916382 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43d800df-d5a6-4b92-99f5-3bcf41181804 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.917533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43d800df-d5a6-4b92-99f5-3bcf41181804 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.918129 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43d800df-d5a6-4b92-99f5-3bcf41181804 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.961512 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-43d800df-d5a6-4b92-99f5-3bcf41181804 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075919 Aug 10 11:30:27.962102 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 591/1194] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:30:27 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:28.975419 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f1f94441-4a7e-4701-ba14-a5e4ca06a3d8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:28.977741 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f1f94441-4a7e-4701-ba14-a5e4ca06a3d8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:28.984169 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1f94441-4a7e-4701-ba14-a5e4ca06a3d8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:28.984654 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1f94441-4a7e-4701-ba14-a5e4ca06a3d8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:28.985087 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1f94441-4a7e-4701-ba14-a5e4ca06a3d8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:28.985785 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1f94441-4a7e-4701-ba14-a5e4ca06a3d8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:28.986236 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1f94441-4a7e-4701-ba14-a5e4ca06a3d8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:28.986681 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1f94441-4a7e-4701-ba14-a5e4ca06a3d8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:29.016912 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f1f94441-4a7e-4701-ba14-a5e4ca06a3d8 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046492 Aug 10 11:30:29.017666 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 604/1195] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 11:30:28 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:30:29.028009 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:29.028531 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:29.035227 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:29.035724 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:29.036161 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:29.036871 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:29.037323 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:29.037748 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:29.117131 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] HTTP exception thrown: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c is not attached to volume aea26fd4-31b2-4861-aa8b-3ffab9600aa8 Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Request method failure captured: Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments/aea26fd4-31b2-4861-aa8b-3ffab9600aa8 HTTP/1.1 Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85YYSKyUBQMgjVST3A9fhTUCAV1_LpGl7-UzTzTdir90sWH8G8f-JAnYLNgDIIkbB_q6GOvDMjGApWcpYHyelpHrSSWenVxHo3tAjEwQukR7LU_9SygX59jIG_mICKvwhSAMFWbl0TA82ckA42pZLxo-cUML6aqquqYXGWfxpcmLJMg Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: f177eb8b84f3461a8957a8171381638a Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-341193915 Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:30:29.119753 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f177eb8b84f3461a8957a8171381638a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f177eb8b84f3461a8957a8171381638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f177eb8b84f3461a8957a8171381638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f177eb8b84f3461a8957a8171381638a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-341193915 Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: f177eb8b84f3461a8957a8171381638a Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-341193915 Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-341193915-project Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 432f5f0682b143f8a4e1319f2285da5e Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-341193915-project Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:30:29.121654 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c is not attached to volume aea26fd4-31b2-4861-aa8b-3ffab9600aa8 Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '203bc62a-cc5e-4cb5-9613-72eeac844d8c', 'id': 'aea26fd4-31b2-4861-aa8b-3ffab9600aa8'} Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id aea26fd4-31b2-4861-aa8b-3ffab9600aa8. Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:30:29.122820 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c is not attached to volume aea26fd4-31b2-4861-aa8b-3ffab9600aa8 Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c is not attached to volume aea26fd4-31b2-4861-aa8b-3ffab9600aa8 Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:29.124900 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Returning 404 to user: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c is not attached to volume aea26fd4-31b2-4861-aa8b-3ffab9600aa8 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:30:29.126315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f987f9d7-cfd2-4fd3-8fd8-25cf20ff4a7b tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "DELETE /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments/aea26fd4-31b2-4861-aa8b-3ffab9600aa8" status: 404 len: 154 microversion: 2.1 time: 0.097158 Aug 10 11:30:29.126315 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 592/1196] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 11:30:29 2022] DELETE /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c/os-volume_attachments/aea26fd4-31b2-4861-aa8b-3ffab9600aa8 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:30:30.266977 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:30.267573 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:30.275881 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:30.276366 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:30.276799 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:30.277510 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:30.277959 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:30.278382 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:30.311904 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:30:30.400989 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b50afffc-6110-454b-8292-a5adb8b9c088 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "DELETE /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 204 len: 0 microversion: 2.1 time: 0.138203 Aug 10 11:30:30.401662 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 605/1197] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 11:30:30 2022] DELETE /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:30:30.410033 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:30.410781 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:30.418220 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:30.418752 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:30.419345 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:30.420049 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:30.420626 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:30.421055 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:30.554903 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:30.563067 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-710807ef-806b-4c38-88c0-2464b573fe1f tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1553 microversion: 2.1 time: 0.157089 Aug 10 11:30:30.563675 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 593/1198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:30 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:31.584865 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:31.585568 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:31.592237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:31.593302 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:31.593733 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:31.594426 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:31.594904 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:31.595321 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:31.730618 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:31.738480 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d6355be6-2e92-4710-859e-e135328f6bc1 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1553 microversion: 2.1 time: 0.157860 Aug 10 11:30:31.739090 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 606/1199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:31 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:32.760025 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:32.760640 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:32.767240 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:32.767722 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:32.768154 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:32.768850 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:32.769297 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:32.769731 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:32.910782 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432f5f0682b143f8a4e1319f2285da5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177eb8b84f3461a8957a8171381638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:32.919588 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-03e8341e-70fd-42aa-b59c-b61a9adf64b9 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 200 len: 1553 microversion: 2.1 time: 0.163515 Aug 10 11:30:32.920941 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 594/1200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:32 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:33.049752 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-0238e933-3515-4297-bd3f-bd4ee6a21013 req-4895b8b9-5b12-47fd-bbf0-435b114bfd08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203bc62a-cc5e-4cb5-9613-72eeac844d8c", "name": "network-vif-deleted", "tag": "f5ef0611-98f6-4baf-81f8-25512797d5fe"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:33.060827 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-0238e933-3515-4297-bd3f-bd4ee6a21013 req-4895b8b9-5b12-47fd-bbf0-435b114bfd08 service nova] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:33.061399 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-0238e933-3515-4297-bd3f-bd4ee6a21013 req-4895b8b9-5b12-47fd-bbf0-435b114bfd08 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:33.061832 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-0238e933-3515-4297-bd3f-bd4ee6a21013 req-4895b8b9-5b12-47fd-bbf0-435b114bfd08 service nova] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:33.074015 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-0238e933-3515-4297-bd3f-bd4ee6a21013 req-4895b8b9-5b12-47fd-bbf0-435b114bfd08 service nova] Creating event network-vif-deleted:f5ef0611-98f6-4baf-81f8-25512797d5fe for instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c on hv-cinder-85272 Aug 10 11:30:33.080625 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-0238e933-3515-4297-bd3f-bd4ee6a21013 req-4895b8b9-5b12-47fd-bbf0-435b114bfd08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034992 Aug 10 11:30:33.081237 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 607/1201] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:33.941262 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:33.941887 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] [instance: 203bc62a-cc5e-4cb5-9613-72eeac844d8c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:33.948584 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:33.949077 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:33.949511 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:33.950214 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Acquiring lock "9412f8ab-5880-4cdf-b6de-459533ed5749" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:33.950701 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:33.951129 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Lock "9412f8ab-5880-4cdf-b6de-459533ed5749" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:33.965776 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] HTTP exception thrown: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c could not be found. Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Request method failure captured: Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c HTTP/1.1 Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Connection: close Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Host: 10.222.0.49 Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi85YYSKyUBQMgjVST3A9fhTUCAV1_LpGl7-UzTzTdir90sWH8G8f-JAnYLNgDIIkbB_q6GOvDMjGApWcpYHyelpHrSSWenVxHo3tAjEwQukR7LU_9SygX59jIG_mICKvwhSAMFWbl0TA82ckA42pZLxo-cUML6aqquqYXGWfxpcmLJMg Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Id: f177eb8b84f3461a8957a8171381638a Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-341193915 Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Role: member,reader Aug 10 11:30:33.968281 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f177eb8b84f3461a8957a8171381638a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f177eb8b84f3461a8957a8171381638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f177eb8b84f3461a8957a8171381638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f177eb8b84f3461a8957a8171381638a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-341193915 Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Id: f177eb8b84f3461a8957a8171381638a Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-341193915 Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-341193915-project Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Id: 432f5f0682b143f8a4e1319f2285da5e Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-341193915-project Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: method: > Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: exception: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c could not be found. Aug 10 11:30:33.970017 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: action_args: {'id': '203bc62a-cc5e-4cb5-9613-72eeac844d8c'} Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c could not be found. Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:30:33.970985 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c could not be found. Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c could not be found. Aug 10 11:30:33.972658 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 10 11:30:33.974171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Returning 404 to user: Instance 203bc62a-cc5e-4cb5-9613-72eeac844d8c could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:30:33.974171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3ea2c05a-5e6a-469b-bc57-78cfefb03d31 tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c" status: 404 len: 111 microversion: 2.1 time: 0.032319 Aug 10 11:30:33.974171 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 595/1202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:33 2022] GET /compute/v2.1/servers/203bc62a-cc5e-4cb5-9613-72eeac844d8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:30:33.979361 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-43bff1cc-38d6-4775-a03e-33b58553891a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] Calling method '.version_select at 0x7fccf834c700>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:34.001638 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-43bff1cc-38d6-4775-a03e-33b58553891a tempest-TestMinimumBasicScenario-341193915 tempest-TestMinimumBasicScenario-341193915-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-694377268" status: 202 len: 0 microversion: 2.1 time: 0.026364 Aug 10 11:30:34.002218 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 608/1203] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 10 11:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-694377268 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:31:19.235252 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:31:19.236107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Wed Aug 10 11:31:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:33:08.639478 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:33:08.640097 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Wed Aug 10 11:33:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:33:22.885604 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:33:22.886183 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Wed Aug 10 11:33:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:33:23.254637 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:33:23.255107 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Wed Aug 10 11:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:33:23.279533 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:33:23.279685 dv-cinder-852724-1-iscsi devstack@n-api.service[117920]: Wed Aug 10 11:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:33:39.063559 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:33:39.064099 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Wed Aug 10 11:33:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:34:39.243712 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:34:39.244355 dv-cinder-852724-1-iscsi devstack@n-api.service[117919]: Wed Aug 10 11:34:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!